Yes it can be done by editing the ribbon.
However, although the File menu can be edited it cannot be removed completely if the ribbon is visible.
The easiest way may be to hide the ribbon completely.
Then just use Ctrl+C, Ctrl+V to copy and paste Or create your own right click context menu with those two items only.