Performance issues when using Templar Astrolabe

For context: have been knocking out challenges, PC performed fine/normally while using the Harvest Astrolabe, switched over to Templar so I could knock out the Settlers-related challenges and now my PC is acting like I'm trying to compute answers to life's hardest questions. If I had to guess, I think the flower power is causing some type of issue.

Noticeable problem: Game becomes laggy when using Templar Astrolabe, delay in time from input to action.

Things about my character that could impact the performance (but, again, zero issues when using Harvest Astrolabe / setup):
-Skills used for map clearing: Arc of Oscillating + Greater Chain Support, single target hard-to-kill is Incinerate of Venting
-Build is the normal Rathpith + Energy Blade + Foulborn Ghostwrithe setup

Computer specs:
-Processor: Intel i9-10900KF 3.7GHz
-GPU: NVIDIA RTX3080 10GB
-RAM: 16GB

Game settings (did not change any between farming strategies):
-Renderer: DirectX12
-Triple-Buffering: Disabled
-FPS Cap to 60
-Dynamic Culling: Enabled
-Dynamic Resolution: Enabled
-Target Framerate: 60
-Engine Multithreading: Enabled(Default)