You could also try to reinstall the Shell Experience components or show the local taskbar in the Remote desktop.
There are several suggestions you can check out to resolve this problem, you can try to restart the process of Windows Explorer via Task Manager or you could clear the cache for multiple processes. This is actually different from the taskbar being hidden automatically until the pointer hovers on it since, in this scenario, the taskbar is completely not accessible which makes using the remote computer entirely difficult, if not impossible. The Remote Desktop Connection feature uses the RDP which allows users to access a computer remotely. Recently, several users reported an issue on their Windows 10 computers where the taskbar is not visible when they tried to connect to a computer via Remote Desktop Protocol or RDP. What to do if Taskbar is not visible in Remote Desktop in Windows 10