Hello Aphi. The problem that you are having no recent tasks showing in the taskbar context menu is due to Windows not displaying Jump Lists, that shows recent files or frequent URLs for pinned apps such as Chrome or VS Code. Sometimes, Jump Lists will be disabled or reset from a system reinstall. The best fix is to go to Settings > Personalization > Start, and make sure that the option "Show recently opened items in Jump Lists on Start or the taskbar" is ON.
Here's the reference: Recent items not visible under Taskbar icons in Windows 11/10
Note: I am providing this information as a convenience to you. The sites are not controlled by Microsoft. Microsoft cannot make any representations regarding the quality, safety, or suitability of any software or information found there. Please make sure that you completely understand the risk before retrieving any suggestions from the above link.
If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".
Best regards,