The Multilingual Natural Language pipeline is the core of the technology which enables large-scale processing of text in many languages, committed to high accuracy and speed in all tasks. Multilinguality is a key feature of the pipeline, with most modules available in 13 languages. Moreover, we feature:
parallelism of independent modules
modularization, with an effective pipeline customized to each specific need
large scale, making it possible to process millions of texts in seconds
availability both as an online service and as an offline software package
Features
The multilingual Natural Language Processing pipeline includes modules which perform the following tasks, which can be accessed separately and are integrated into the pipeline:
Language recognition
Tokenization
Morphological analysis
Part-of-speech tagging
Named Entity Recognition
Term, concept and entity extraction
Domain labeling
Tag classification
Word Sense Disambiguation and Entity Linking
Semantic vector document creation
Semantic document similarity of sentences, paragraphs and documents
Sentiment analysis
Babelscape’s NLP pipeline comes with several groundbreaking features. It is designed to work on a large scale in dozens of languages using the same interface for each language. Users can choose only the modules they need and can run dozens of tasks in parallel on the same CPU. The pipeline also integrates our flagship products as modules: WordAtlas, Comprehendo and Extraggo, thanks to which a full-fledged analysis of text can be performed, ranging from tokenization to semantic analysis and text analytics.
Language Coverage
Arabic
(Arabic),
Chinese
,
Dutch; Flemish
(Latin),
English
(Latin),
French
(Latin),
German
(Latin),
Italian
(Latin),
Japanese
(Japanese (alias for Han + Hiragana + Katakana)),
Korean
(Korean (alias for Hangul + Han)),
Polish
(Latin),
Portuguese
(Latin),
Russian
(Cyrillic),
Spanish; Castilian
(Latin)
