DarkBERT, Scientists new AI trained Language model for the dark side of the internet
An AI trained large language model, DarkBERT developed to fight against hackers.
Artificial intelligence language models are setting goals for new technology. Large language models are all in news these days. OpenAI’s language model and Google bard are all trained on text data.
However, some bunch of researchers believes that large language models should be trained on the dark web. Consequently, researchers have done just the same way with DarkBERT to get surprising results.
What is DarkBERT?
A team of South Korean researchers have released a paper detailing how they built an LLM on a large-scale dark web corpus collected by crawling the Tor network.
Further, the data included a host of shady sites from various categories including crypto currency, pornography, hacking, weaponry, and others.
However, due to ethical concerns, the team did not use the data as is. To ensure that the model wasn’t trained on sensitive data so that bad actors aren’t able to extract that information, the researchers polished the pre-training corpus through filtering, before feeding it to DarkBERT.
DarkBert, is a large language model based on Roberta architecture. It is a transformer based model which was developed in 2019 by Facebook.
In addition, DarkBert is a new way of fighting cyber-crime. “Our evaluation results show that DarkBERT-based classification model outperforms that of known pretrained language models,” the researchers wrote in their paper.
However, at present Korean researchers improved the model. Researchers input the dark web data of last 15 days which was eventually coming on DarkBert.
Therefore, after analysing the team claims their new LLM was far better at making sense of the dark web than other models that were trained to complete similar tasks.
Purpose of DarkBert
Further, researchers suggests DarkBERT could be used for a variety of cyber security related tasks, such as detecting sites that sell ransom ware or leak confidential data.
Furthermore, it could also be used to crawl through the countless dark web forums that get updated daily and monitor them for any exchange of illicit information.
DarkBert Availability
It is presently unavailable to general public. However, researchers plan to release the pre-processed version of DarkBERT. The version that is ready for outcome. Besides, the final date is yet to unveiled.
Regardless, DarkBERT represents a future where AI language models are trained for specific tasks. Eventually, DarkBERT is a specialised weapon to stop hackers.
