+-------------------+ +--------------------+ +-------------------+ | Live Site (Sicflics) | --> | Distributed Crawler | --> | Raw Data Store (S3) | +-------------------+ +--------------------+ +-------------------+ | v +-------------------+ | Processing Pipe | +-------------------+ | v +-------------------+ | Searchable Index | +-------------------+ | v +-------------------+ | Public Mirror (IPFS) | +-------------------+

The thrill of torrenting!

, here’s a sample: