This is presumably a lime kiln, though the arch/eye is strangely shaped and lacks the typical refactory brick lining.

It's construction is unusual too, built well into the side of a hill.