Article may be outdated

This article is 58 days old. Some details may have changed since publication.

Hacker News·3 min read·hard

SearXNG in Rust

D
dluuuu
SearXNG in Rust
✦AI Summary

A new open-source search engine project written in Rust has been released, designed to aggregate results from multiple search engines. It uses Reciprocal Rank Fusion to deduplicate and rank results from providers like DuckDuckGo, Brave, and Yahoo.

Why it matters

This tool provides developers with a lightweight, high-performance alternative for building custom search aggregators using modern memory-safe programming languages.

✦Dive DeeperCreate a free account to unlock

A SearXNG-style metadata search engine written in Rust. Fans out queries to multiple search engines concurrently, scrapes their HTML results, deduplicates by normalized URL, and ranks using Reciprocal Rank Fusion (RRF).

A search request arrives at GET /search?q=<query> The query is sent concurrently to DuckDuckGo, Brave, Startpage, and Yahoo via reqwest Each engine parses the HTML response with scraper (CSS selectors over Mozilla's html5ever) Results are deduplicated by normalized URL (tracking params stripped, locale prefixes removed, query params sorted) Duplicate URLs are merged and scored with RRF ( score = Σ 1/(60 + rank) across engines) — pages returned by multiple engines rank higher The top results are returned as JSON Requirements Rust 1.75+ Cargo Installation As a library cargo add metadata-search-engine-rs Or add manually to Cargo.toml :

Continue reading on Headlinne

Create a free account to read the full article.

Read full article →
technology
✦

Get smarter about the news

Sign up free for a feed built around what you actually care about, Dive Deeper research on any story, and the full text of every article.

Create free account

Already have an account? Sign in