Open-source intelligence (OSINT) data sources are continually being added to Primer Pulse. Below is a breakdown of all the data sources currently available.
Social Media
Available sites include: X/Twitter, Reddit, Telegram, Discord, 4Chan, 8kun, Gab, and MeWe, Pastebin, Looksmax, Stormfront, Mastodon, Tutiao, Weibo, Xueqiu and Vk. Here's a brief description of each:
X/Twitter: Twitter is a microblogging and social networking service on which users post and interact with messages known as "tweets".
Reddit: A social news aggregation, content rating, and discussion website. Registered users submit content to the site such as links, text posts, images, and videos, which are then voted up or down by other members. Posts are organized by subject into user-created boards called "communities" or "subreddits".
Please Note: Primer currently collects only a subset of subreddits. To have additional subreddits added, please reach out to [email protected].
Telegram: A free cloud-based chat application that offers built-in end-to-end encrypted video calling, file sharing, and other advanced features.
Please Note: Primer currently collects 11,000+ Telegram channels. To have additional channels added, please reach out to [email protected].
Discord: a VoIP and instant messaging social platform. Users have the ability to communicate with voice calls, video calls, text messaging, media and files in private chats or as part of communities called "servers". A server is a collection of persistent chat rooms and voice channels which can be accessed via invite links.
Please Note: Primer currently collects only a subset of Discord servers. To have additional servers added, please reach out to [email protected].
4chan: A notorious imageboard. It was created in 2003 as an English-language counterpart to similar Japanese forums dedicated to anime discussion. Over time, 4chan grew to become a central hub of internet culture, with associations to Anonymous and alt-right politics. Over the years, users of the site have been implicated in murders, distribution of child sexual abuse imagery, and cyberattacks.
Please Note: Primer currently collects a subset of 4chan content. To have additional content added, please reach out to [email protected].
8kun: Known previously as 8chan, 8kun is most famous for being the origin of QAnon. In addition, users of the site have engaged in several mass murders, distribution of child sexual abuse imagery, and swatting.
Please Note: Primer currently collects a subset of 8kun content. To have additional content added, please reach out to [email protected].
Gab: An alt-tech platform that frames itself as a bastion of free speech and individual liberty. However, its lack of moderation has allowed extremist communities to become established on the site. As such, Gab is rife with antisemitism, racism, and white nationalist rhetoric. The format is similar to Twitter, with individuals posting on their own timeline, or in groups.
Please Note: Primer currently collects a subset of Gab content. To have additional content added, please reach out to [email protected].
MeWe: A social media network often compared to Facebook that focuses on data privacy and engages only in limited moderation of provocative content.
Please Note: Primer currently collects a subset of MeWe content. To have additional content added, please reach out to [email protected].
Pastebin: A historically popular website used by software developers to store text and easily share across different communities. Despite these innocuous uses, Pastebin is also used by bad actors to store malware scripts, stolen information, and at times used for propagating mis- and dis- information.
Please Note: Primer currently collects a subset of Pastebin content. To have additional content added, please reach out to [email protected].
Looksmax: A popular incels stomping ground to discuss "lookism" and to bash each other on how they look. Far right Nazi content can be found here as well.
Please Note: Primer currently collects a subset of Looksmax content. To have additional content added, please reach out to [email protected].
Stormfront: A neo-nazi internet forum.
Please Note: Primer currently collects a subset of Stormfront content. To have additional content added, please reach out to [email protected].
Mastodon: A "federated" microblogging platform much like Twitter. Individuals have the power to host their own Mastodon instance and center that instance around a community of similar interests. These instances can then be connected to other instances in a federated network.
Please Note: Primer currently collects a subset of Mastodon content. To have additional content added, please reach out to [email protected].
Toutiao: A Chinese news aggregation platform owned by China's ByteDance.
Please Note: Primer currently collects a subset of Toutiao content. To have additional content added, please reach out to [email protected].
Weibo: China's microblogging platform like Twitter. Given that Twitter is blocked in China, Weibo is the dominant microblogging platform inside China and also used by Chinese diaspora.
Please Note: Primer currently collects a subset of Weibo content. To have additional content added, please reach out to [email protected].
Xueqiu: A Chinese financial platform similar to Seeking Alpha.
Please Note: Primer currently collects a subset of Xueqiu content. To have additional content added, please reach out to [email protected].
VK: A Russian social networking service. VK users can message publicly or privately, and create groups, public pages and events.
News Data
Primer ingests the LexisNexis news data set, a collection of 50,000+ sources from all over the world. The knowledge base of events, entities, and relationships is continually updating and has been backfilled with English-language data going back 2 years to present day.
If you have any questions about these data sources, or have requests for additional sources, please reach out to our team at [email protected]
