Gemma4.java: Run Gemma 4 in pure Java (no Python, no JNI)

 (github.com)

1 points | by mukel 3 hours ago

1 comments

  • mukel 3 hours ago
    I built llama3.java in the past, this is a follow-up: Gemma 4 running entirely on the JVM.

    No Python. No JNI. No native code. Just Java.

    It’s (mostly) a single Java file implementing the full stack:

    GGUF parsing, tokenization, Gemma 4 transformer inference, quantizations, CLI...

    Built using the Java Vector API, with support for GraalVM Native Image.