It seems like this comment has gone widely unnoticed. https://old.reddit.com/r/LocalLLaMA/comments/1tvtn6m/googlegemma412b_hugging_face/opjj681/ Maybe hold off on testing quantization and wait for it's refinements. The account is Omar from the gemma team. submitted by /u/Aaaaaaaaaeeeee [link] [comments]