What is Traffic Data Friction?
It’s the delays and difficulties that confront network engineering, operations, and marketing professionals in collecting, transforming, integrating, and analyzing the enormous volumes of data generated by network devices and events.
Machine Learning and AI promise new capabilities for automated network bandwidth management, detection of fraud and abuse, predictive equipment maintenance, and optimized user experience. But without the ability to deliver integrated streaming data to predictive algorithms in real time, the automated network decisions are not timely or accurate.
What is the solution?
VelociData’s unique carrier-scale Network Data Fabric for real-time network monitoring, analytics, and optimization eliminates network data friction. It collects and transforms network protocol data, integrates that with data about devices, subscribers, applications, and services, and delivers actionable network intelligence to operations, engineering, and marketing.
The VelociData Network Data Fabric provides operators with deep real-time network visibility, and it enables predictive analytics for responsive automation, maintenance, product development and more.
Collection
Increasing volume, variety and velocity of network traffic data is making it harder to capture it in a timely, efficient way. Network operators are forced to use cumbersome procedures and many different tools to sample and preprocess traffic data, increasing their reaction time to critical risks, threats, and opportunities.
VelociData Raptor provides a single real-time network data collection engine for all devices and protocols, including bi-directional protocols.
Raptor for Real-Time Traffic Data Collection and Transformation
VelociData Raptor uses advanced parallelism to collect and transform large volumes of streaming network traffic monitoring data in all common protocols and deliver it to common platforms and tools for network management and analytics.
Integration
Network traffic monitoring is not enough anymore. Operators need more than protocol data for effective network management. Optimizing operations and delivering the best network user experience requires the combination of traffic data with information about subscribers, applications, and devices.
VelociData Vortex enables real-time integration of streaming network traffic data with data from internal business and operations systems about subscribers, services, network performance, and engineering, plus external data from partners, government agencies, and third-party data providers.
Vortex for Real-Time Integration of Traffic, Enterprise, Operations and Other Data
VelociData Vortex is a complete real-time data integration engine that ingests, combines, and manipulates data from Raptor, databases, FTP, and streaming services like Kafka, according to user-defined rules, and exports processed data to a wide variety of analytics and management platforms.
Transformation
Data from established network monitoring protocols like SNMP, IPDR/SP, and BMP, and newer ones like NetFlow, IPFIX, SFLOW, and Telemetry, create ever-increasing data transformation challenges for network operators. The growing complexity of raw traffic data requires new tools and techniques for turning it into actionable traffic intelligence.
Transformations are specified in a SQL-like language that enables multi-step processing and business rules, simple correlations between protocols, and enrichment with data from external systems. And VelociData’s efficient timeseries database enables all of this to be executed in real-time.
One System for All Network Monitoring Protocols
VelociData combines rich protocol-specific data processing for SNMP, IPDR, NetFlow/IPFIX, and Telemetry with a single, flexible user interface. Subject matter experts easily specify desired monitoring, control, and response procedures for all protocols and the system does the rest.
For IPDR/SP, VelociData provides thorough support for all relevant DOCSIS templates.
For NetFlow/IPFIX and Telemetry, VelociData flattens and formats the monitoring data to suit the needs of downstream tools. Operators can interactively sample the data, view collector statistics and transform hierarchical data protocol schemas to the desired schemas for stream and table bases analytics tools.
Powerful Protocol Benefits
- VelociData makes it easy to onboard new protocols and templates (NetFlow/IPFIX, IPDR/SP), sensor groups (Model-Driven telemetry), and OIDs/MIBs (SNMP) through our data explorer, sampler, and rules creation UI.
- VelociData’s rules processing engine takes the data from a protocol-native schema stored in our internal format and creates a user-specified output schema in our internal format (possibly through multiple transforms).
- VelociData’s exporter takes the user schemas and renders them to desired format (e.g. CSV, XML, JSON, Avro, …) and delivers them to one or more specified destinations.