[OpenWrt-Devel] Slow DNSMasq with > 100, 000 entries in additional addresses file

[philipp_subx at redfish-solutions.com]

> On Dec 26, 2016, at 10:32 AM, TheWerthFam <thewerthfam at gmail.com> wrote:
> 
> Using the adblock set of scripts to block malware and porn sites. The porn sites list is 800,000 entries, about 10x the number of sites adblock normally uses.  With the full list of malware and porn domains loaded, dnsmasq takes 115M of memory and normally sits around 50% CPU usage with moderate browsing usage.  CPU and RAM usage isn't really a problem other than lookups are slow now. Platform is cc 15.05.1 r49389 on banana pi r1.
> 
> The adblock script takes the different lists, creates files in /tmp/dnsmasq.d/ entries looking like
> local=/domainnottogoto.com/   one entry per line.  The goal is to return NXDOMAIN to entries in the lists. Lists are sorted and with unique entries.
> 
> I've tried increasing the cachesize to 10,000 but that made no change.  Tried neg-ttl=3600 with default negative caching enabled with no change.
> 
> Are there dnsmasq setting that will improve the performance?  or should it be configured differently to achieve this goal?
> Perhaps unbound would be better suited?
> 
> Cheers
>    Derek


Not to rain on your parade, but the obvious defeat of this solution would be to point to an external website which does DNS lookups for you, and then edit the URL to have an IP address in place of the host name.

I would use netfilter’s NFQUEUE and make a user-space decision based on packet-destination (since it seems you’re filtering outbound traffic requests).

After all, it’s not the NAME you don’t want to talk to… it’s the HOST that bears that NAME.

-Philip
_______________________________________________
openwrt-devel mailing list
openwrt-devel at lists.openwrt.org
https://lists.openwrt.org/cgi-bin/mailman/listinfo/openwrt-devel