GEORGETOWN, Guyana—Along the sea wall separating this sleepy capital’s moldering wooden houses from the coffee-colored Atlantic, construction workers in hard hats rush to expand ports, build luxury condos and open the country’s first Hard Rock Café.

The developments aim to tap the expected wealth from what until recently was unimaginable for this jungle-covered former British colony: oil.

An...