Open-Source macOS Search Tool Powered by EmbeddingGemma 2 and llama.cpp

X postXuan-Son NguyenTool

Xuan-Son Nguyen highlights a new community project from Reddit: an open-source macOS search app running EmbeddingGemma 2 locally via llama.cpp.

Key points

  1. The application leverages EmbeddingGemma 2 for local search on macOS, outperforming the native Spotlight tool according to Nguyen.
  2. The tool uses llama.cpp for local inference.
  3. Developer @_ARahim_ confirmed that versions for Windows and Linux are currently in development.

Why it matters

On-device embedding models enable secure, privacy-preserving semantic desktop search without sending file data to the cloud.

Analysis

While traditional desktop search tools like macOS Spotlight rely heavily on exact text matches and metadata, local embedding models like EmbeddingGemma 2 allow semantic retrieval directly on consumer hardware via llama.cpp.

Original post

Xuan-Son Nguyen

@ngxson · 11 October 2026

t.co/dEe3yuO27J

97 likes0 replies154 bookmarks11.9k views

View on X
More posts in the thread (2)
  1. Someone on Reddit made a searching app that runs on EmbeddingGemma 2 🤯 Much better than MacOS's default Spotlight 🔥 t.co/pT0qex0OgE
  2. @_ARahim_ Cool project! Great use of llama.cpp too 😁
Selected replies (5)
  • @_ARahim_ @ngxson That was me, thanks for sharing it. t.co/9Amgb3KqZC
  • @Fanfulladev @ngxson Searching your own videos by describing the scene, fully offline, should be built into every OS
  • @_ARahim_ @ngxson Thank you. Currently working on windows and Linux port.
  • @GlennCameronjr @ngxson EmbeddingGemma 2 is a real cool model. You can build so many things with it.
  • @Hft_freedom @ngxson @raycast mate

Mentioned links

Summary generated by AI (Gemini 3.8 Flash, 12 October 2026). It may contain errors – the original source is authoritative.

Related entries

Similar in content, found by the AI search.

  • X post:Xuan-Son Nguyen

    Local Desktop Search Tool Powered by EmbeddingGemma 2 and llama.cpp

    A desktop search utility shared on Reddit runs EmbeddingGemma 2 via llama.cpp to index and retrieve local files on macOS. Xuan-Son Nguyen highlighted the tool, calling it far superior to Apple's default Spotlight search.

    2.3kbookmarks260.3kviews

    AI & LLMs· Tool

  • Repository:drumih/turbo-fieldfare

    TurboFieldfare: Gemma 4 26B-A4B Inference in 2 GB RAM on Apple Silicon

    TurboFieldfare is a dedicated Swift and Metal runtime designed to run Google's Gemma 4 26B-A4B on Apple Silicon Macs within an approximately 2 GB RAM budget. It avoids loading the full 14.3 GB model into memory by keeping only the 1.35 GB core and KV cache in RAM while streaming the required mixture-of-experts weights from SSD on demand.

    6.6kstarsSwift

    AI & LLMs· Tool

  • X post:Mia

    Google Releases EmbeddingGemma 2: Unified Multimodal Vector Space

    Google has launched EmbeddingGemma 2, an open-weights model mapping text, code, images, video, and audio into a single shared vector space. The 1.49 GB model is released under the Apache 2.0 licence.

    684bookmarks37kviews

    AI & LLMs· Announcement

  • Link:drumih

    TurboFieldfare: Running Gemma 4 26B in 2 GB RAM on Apple Silicon

    TurboFieldfare is an open-source inference engine written in Swift and Metal that executes 4-bit Gemma 4 26B-A4B-IT on Apple M-series Macs using roughly 2 GB of RAM. While the model weights require 14 GB of disk space, the engine keeps only the shared model base and KV cache in memory and streams routed expert layers on demand directly from the SSD.

    AI & LLMs· Tool

  • Repository:google-ai-edge/LiteRT-LM

    LiteRT-LM: Google's Open-Source Inference Framework for On-Device LLMs

    LiteRT-LM is an open-source inference orchestration layer from Google designed to run large language models directly on edge devices. It leverages GPU and NPU acceleration and powers on-device generative AI features in Chrome, Pixel Watch, and Chromebook Plus.

    6.4kstarsC++

    AI & LLMs· Tool

Back to the knowledge base

Let's talk about your project

Get in touch

Locations

  • Mattersburg
    Johann Nepomuk Bergerstraße 7/2/14
    7210 Mattersburg, Austria
  • Vienna
    Ungargasse 64-66/3/404
    1030 Wien, Austria

Parts of this content were created with the assistance of AI.