masonry drilling

Should I keep trying to drill above this window?

I’m renting a place with a wide window and want to hang a double curtain rod. The wall seems to be brick or concrete behind a thin finish,…