Apparently having giving a user administrator privilages for the Exchang server and/or public folders doesn't necessarily grant them permission to edit the contents of public folders. Adding permissions for a user to a folder is done in the managment shell with:
Add-PublicFolderClientPermission –Identity “Foldername” –user UserName –AccessRights PublishingEditor
More info
here.