Presuming this is for vegetable growing, it would be okay if there is a depth of at least 30cm of soil/compost. It the raised bed is for flowers, it could be a bit less for small plants and up to twice that depth for shrubs.
The gravel will act to improve drainage.