It is called an "inlet"or a "cove". It could also be called a "bay". Come to think of it... It could be called (if salty), an "estuary".
What is a narrow body of water with land on both sides?
Is it moving? If so, a river. I know that the Long Island Sound is a body of water with land on both sides, but I am not sure if it moves.