Blog

We’ve been writing libraries for Spark at Uncharted for several years, and continuous integration involving the Spark runtime has always been a difficult thing to accomplish. Common approaches, such as creating a Spark context within a standard Scala runtime, can fail to accurately emulate nuances of the distributed Spark environment. I’d like to share a solution we’ve developed for creating a native Spark test environment within TravisCI.

Reporting on the release of a suite of open source tools designed to significantly improve “dark web” searches, Forbes highlights two key Uncharted technologies, TellFinder and Aperture Tiles, the original research project from which Salt was developed.

A new Wall Street Journal article describes how TellFinder can drastically simplify searches for illicit behavior online. TellFinder automatically aggregates similar web posts to eliminate the need for investigators to perform highly manual link-by-link examinations of every result.

A recent Scientific American article details efforts to revolutionize Internet search technology by allowing people to review “deep web” data and search and review results in a fraction of the time. TellFinder, our search tool for finding and visualizing connections in structured and unstructured media stores, was designed to address these goals.

Two innovative Uncharted technologies, TellFinder and Salt, were featured in a segment on 60 Minutes last night. Leslie Stahl looks into how the tools are being used by criminal investigators to uncover suspected cases of human trafficking in the “deep” and “dark” corners of the web ignored by traditional search engines.