Data Solutions

SPi’s flagship, intelligent, end-to-end technology platform, SPARK brings together modular AI-based components to address the diverse data management challenges faced by enterprises across multiple verticals.

SPARK is a one-stop solution, addressing data acquisition, data quality, and the transformation of analytics-ready data. The platform and its modules are especially powerful when processing unstructured data, an ongoing challenge for enterprises of all kinds.

The platform features three principal modules.

Extraction Module
Built on an ML engine, SPARK’s extraction module leverages cognitive models to achieve industry-leading accuracy in extracting unstructured data from PDFs, documents, maps, emails and images.

The extraction module also uses SPi’s next-generation web harvesting platform, powered by AI and NLP accelerators, to extract information and monitor websites for raw, standardized data.

• Technology-assisted source acquisition for a more systematic and thorough approach to acquiring the right data.
• Nimble approach allows a single script to extract similar data from multiple sites.
• Data cleansing, structuring and noise removal at the acquisition stage save significant storage costs downstream.
• Web page monitoring tracks and captures website changes as they happen.
• Server-based PDF extraction and OCR reduces load on user devices.
• Automated identification of potential issues such as font details, uncertain spacing and soft hyphens within the extracted file, reduces the need for human curation.
• Table, image and diagram extraction included as standard.
• Small sample sizes for training high levels of automation through ML.

Transformation Module
Leveraging a quality framework built on our custom AI and ML models, and algorithms customized for each industry, SPARK’s transformation module creates and maintains a master dataset from all data fed into it.

• Proprietary knowledge repositories and key de-duplication and standardization suites allow SPARK’s transformation module to scrub reference data such as company and product names, geographies, phone numbers and subject matter expert (SME) terminologies.
• SPARK’s multi-level ML-based model helps disambiguate and link people, company and other datasets to create a single source of truth.

Enrichment Module
Leveraging SME knowledge across multiple domains, SPARK’s Enrichment Module offers information providers and other enterprises a unique opportunity to leverage existing datasets to their full potential.

This module includes entity extraction, taxonomy and classification, summarization, metadata creation and more.

• Customized rules and knowledge repositories for a wide range of domains including finance, legal, real estate, science, engineering, medicine, social sciences and humanities, and inter-disciplinary information.
• Software and SMEs working together ensure scalability and accuracy, supporting stringent SLAs.
• Keyword extraction, indexing and concept identification, along with SEO-optimized summaries.
• In-built NLP modules facilitate concept extraction, editorial and readability checks.

A unique conceptualization and development hub to foster innovation and experimentation, SPi Labs leverages next-generation technologies and open source capabilities. The facility brings together software engineers, SMEs, researchers, data analyst and technology specialists to expand SPi’s capabilities, accelerating the development of innovative solutions that enable organizations and society to make better use of big data and domain knowledge.

SPi Labs success stories include solutions developed for concept extraction and the automated business relevancy discovery in the health and science domain, and semantic analysis and NLP research to understand terminology in legal documents.

As part of this initiative SPi continues to invest in proprietary cognitive technology to target the complex problems commonly encountered in invoice processing and handwritten text recognition.

The essential first step to good data is identifying the right data. We apply proven technology and processes in our Source Discovery and Analysis, Data Acquisition, Cleansing and Normalization, De-duplication and Disambiguation, and Metadata Management services.

If data is oil, enrichment is the refinery. SPi has wide experience in enriching data across multiple industries, our enrichment services including Mapping and Linking, Entity Extraction (indexing), Summarization, Knowledge Modeling and Annotation.

Database Design & Maintenance

Our content support team handles the design of content and data structures and schemas, as well as workflows to implement new capabilities on your hosting platform.

We have rich experience in a wide range of proprietary and open source CMS platforms. Along with our in-depth knowledge of data products, this expertise enables us to provide you with a one-stop solution to optimize all your data processes.

Content Migration

SPi has teams highly experienced in migrating content from legacy platforms to new ones, with a detailed understand of how schemas need to be set up for unstructured data. Our full suite solution includes requirements analysis, content structure mapping, ETL process management, ingestion QA and testing. We have migrated millions of records for leading information providers in the risk and compliance, health and science, and legal domains.

Platform Build and Deploy

With SPARK, our workflow management system, MAGNUS, and custom platforms, SPi builds, customizes and deploys various platforms to help optimize data workflows. All our platforms are built with APIs which can be customized for any CMS and deployed in the cloud or on-premise.

SPi’s team of data experts, including data engineers and data scientists, helps customers with visualization design and implementation, integration of visualization tools with existing workflows, and report building, scheduling and distribution.

Focusing on an outcome-based, analytic approach, SPi helps companies use data to solve business problems. Using an iterative process in the creation of analytic models, we work with customer analytics, marketing analytics, product and sales analytics, operations and logistics analytics, and content analytics.