Stuttering hindering the experience

Hey guys!! After a year of saving I was finally able to build what I'd consider a pretty good PC and I was very excited to jump in today and no-life this game. However, the performance has been subpar to say the least. FPS won't drop but the stuttering has been out of control, I hadn't played PoE 2 on this rig yet but I'm pretty sure something isn't right. I know the game optimization has been a problem but my friends on Discord are saying their game is performing fine. Honestly, my old Legion notebook with a RTX 3050 with 4GB of V-Ram was performing better. When I check the performance graph I see that the CPU bar spikes pretty much match the stuttering... technically I'm able to play the game but it's been very uncomfortable to the eyes.

PC specs

CPU: AMD Ryzen 9 9900X3D
GPU: Radeon 9070xt, 16GB V-RAM
RAM: 48 GB DDR5
Storage: 1 TB NVMe SSD
OS: Windows 11 Home
Display: Samsung Odyssey 164hz, QuadHD res

I have checked some troubleshooting videos and posts here but so far nothing has helped. Below is a list of the steps I've taken:

Out of game optimization

Deleting shaders cache ✔
Checking GPU drivers and OS updates: ✔
Turn off auto-HDR on display settings: ✔
Set PoE 2 to Hyper-RX on AMD Adrenalyn software: ✔
Deleting and completely reinstalling the game: ✔

In game optimization

Turn off V-sync: ✔
Set game to Fullscreen (from windowed FS): ✔
Turn on Mutilthreading: ✔
Turn on/off FSR frame generation: ✔
Set audio channel count to low: ✔
Setting to Vulkan from DX12 and vice versa: ✔

Honestly, I can't remember all the things I've done in the graphics settings in-game but even when I set the game to the lowest possible settings the stuttering continues. Also, this is the only game this has happened, been playing D4 on max for a while with no issues. Also played a bit of the new 007 game yesterday on max settings with no issues as well.

I don't post here often but I'm hoping one of you managed to fix this same problem.
I appreciate the help and thank you all in advance!!
Cheers gamers

My game stutters if I use Mouse Movement instead of WASD. It started a few months after launch and has never been fixed.

Unfortunately I've been playing with WASD movement for this entire time so pretty sure it ain't that.

TY for the reply though =)