Missing gems when running bundler exec fastlane

I'm trying to run fastlane locally on a M1 MacBook. After running bundler exec fastlane deploy I get the following exception:

Could not find json-2.6.3, digest-crc-0.6.5, unf_ext-0.0.8.2 in locally installed gems
Run `bundle install` to install missing gems.

No exception is thrown on running bundle install and it seems like the missing gems are installed, but if I run bundler exec fastlane deploy again, I get the same exception as before.

Any tips on how I can fix this ?