The document outlines an intelligent infrastructure theme that aims to build common frameworks and platforms for intelligent systems across various verticals like transportation, healthcare, education, and energy. It describes the goals of being context-aware, extracting meaningful information from sensed data, analyzing data to make inferences, and responding through value-added information. It provides examples of use cases and discusses the integrated platform called RIPSAC that will be used to develop intelligent infrastructure applications and services.

1. 0
Arpan Pal
Head, Innovation Lab, Kolkata
R&D in Intelligent Infrastructure
Innovation Labs, Kolkata and Bangalore

2. Theme Outline

3. 2
Intelligent Infrastructure Theme
“Intelligent”
• Context-aware
• Sense the environment
• Extract meaningful information
• Analyze to make inferences
• Respond through value-added information
“Infrastructure”
• Home, Building, Store, Vehicle, Roads, Utility
Generation / Distribution Network
Intelligent
Infra
@Home
@Building
@Vehicle
@Utility
@Mobile
@Store
@Road
Target Verticals
• Transportation / Govt. Authorities / Healthcare / Education /
Energy / Water
Goals
• Build common framework and platforms
• Example use cases for initial platform requirements
• Platform Differentiators
• Multi-system Integration and Fusion / Analytics and Privacy Control Toolboxes
• Long term Research Outcomes in
• Sensing, Communication, Informatics, Robustness, Large Data Handling, HMI, Privacy/Trust
and Services
• Service level interfaces on top of the Platform for Business Teams to write Intelligent
Infrastructure Applications

4. 3
Integrated Platform for Intelligent Infrastructure
People Feedback & Emotions
Social Media
Integrated Services
Sensors & IoT
Platform
Traditional Monitoring & Control
Systems
Citizen Data
Smart Integration Platform
Transportation Healthcare Electricity
WaterPublic Safety Tourism
Smart Integrated Services
Sense
Analyze
Extract
Respond
Intelligence
Smart Domain Services
Community
etc.
Sense: People Activity, Appliances, Vehicles , Road, Home/Bldg, Utility
Infrastructure
Detect gas leakage/water contamination :
mobilize rescue team, suggest optimum route
Divert Road Traffic in case of
Water Pipeline Burst
Correlate Electricity/Water
/Gas consumption patterns
Intelligent Integration Platform
Integrated Intelligent Services
Real-time Integrated Platform for Services and Analytics (RIPSAC)

5. 4
Overall Solution Landscape
Example Application Use Cases
Intelligent Transportation
Pothole Detection / Share-a-ride / Unmanned Level Crossing Alert
Car Diagnosis / Prognosis
Driving Behavior Analysis / Automated Insurance Claim
Intelligent Retail
Phone-based localization in Shopping Malls
Intelligent Utility
Home Energy Gateway
Intelligent City Services
Surveillance for Safe City
Remote Healthcare
Distance Education
Intelligent Agriculture
WSN for mKrishi
Internet

6. Research Focus

7. 6
RIPSAC Architecture
Internet
End Users &
Renderers
Administrators
Data Aggregation
Device Monitoring &
Management
Device Integration & Management Services
Visualization
Components
Statistical
Analysis
Machine
Learning
Rule Engines
Event
Processing
Reasoning
& Ontlology
Optimization
Analytics Services
Application
Components
Application Services
Data Storage
Data Access /
Query
Continuous
Queries
Storage
Data & Event
Distribution
Messaging
Messaging & Event Distribution Services
Core Services
ApplicationServices
Presentation Services
Portal User Interfaces
Application Support Services
Integration &
Orchestration
Planners
Platform API
& SDKs
Internet /
WAN
Sensors & Gateway
Devices
OS & Device Drivers
Edge Middleware
Analytics Persistence
Application Services
APPLICATION SERVICES
BACK-END PLATFORM
INTERNET
GATEWAY
Privacy
BACK-END PLATFORM
GATEWAY

8. 7
RIPSAC Platform Research
Challenges
• Reducing the cost of Communication
• Preserving the Battery power
• Extracting information from ambient-noise-corrupted sensor data
• Multi-sensor fusion and analytics, sometimes in real-time
• Security and Privacy
• Common Framework for Sensor Data Acquisition, Storage and Management
Approach
• Edge processing algorithm toolbox (sensor, audio, image, video) for context information
extraction
 addresses the information extraction, cost of communication, privacy and battery power preservation
issue
• Lightweight communication protocols over Internet
 addresses the cost of communication and battery power preservation issue
• Algorithm toolbox for real-time streams / complex event processing, data sketching,
reasoning, fusion and non-parametric statistical processing
 addresses the real-time multi-sensor fusion and analytics issue
• Privacy preserving sensor data masking, encryption and tokenizing toolbox with access
control and authentication
 addresses the security and privacy issue
• OGC based sensor data acquisition, storage and management framework
Collaboration with ISI, Kolkata on Privacy

9. 8
Accelerometer Analytics in Mobiles
Accelerometer Feature extraction and Fusion
Use Case - Pothole detection, Driving behavior analysis
• Learning-based adaptive design
• Feature extraction and anomaly detection done on mobile
device to conserve battery power, reduce communication
cost and preserve privacy
• Voting based Fusion at Back-end
• Low computational complexity algorithm using low rate
sampling
Car-road Interaction Modeling
Use Case - Pothole simulation, Car Prognosis
• Model based on physical interaction between cars and
roads
• Inverse modeling for Car Prognosis

10. 9
Use Case - Help people find a Ride-share
• Social sub-graph formation between ride-
givers and ride-takers
• Real-time decision system based on
instantaneous location and route matching
• Streams Reasoning for real-time traffic
condition alert and suggestions about
alternate ride-givers
• Trust model based on “Friend-of-Friends”
kind of relationship
• Reduction of search complexity
Intent based Social Network Formation

11. 10
Mobile Location based Alerting
Use Case - Automated SMS Alert System for
Unmanned Level Crossings
• Instantaneous prediction train approach
based on location and speed sensing
• Instantaneous identification of mobile
phones in the vicinity of level crossing
through LBS and Intent discovery
• Real-time alert system using SMS
• Streams Reasoning for sophisticated alert
logic

12. 11
Upper Audio band Communication in Mobiles
Use Case - In-store loyalty programs and Target
promotions for Retail
• Complete baseband communication chain
design using upper audio band (16 to 22
KHz) carrier
• Low computational complexity to preserve
battery power
• Novel waveform design for fast detection
time (less than 1 second)
• Programmable range (1 m to 8 m) through
power control
• Error Control Coding for Robustness

13. 12
Multimedia Processing for Context Extraction
Use Case – Indoor People Counting for TV
Viewership
• Multi-algorithm fusion to improve detection
probability
• Face Detection, Body Posture Detection and
Background Modeling are combined to
improve the detection above 92 % from 75 %
Use Case – Audio and Gesture-based Interaction
• Gesture sensing through Kinect
• Resolution of Multi-party commands through
directional audio augmented with gesture

14. 13
Image Processing in Mobiles
Use Case – Automated Insurance Claim
• Noise cleaning and pre-processing on VIN
Images
• Low computational complexity OCR on
VIN images
• Vehicle Contour based Damage Estimation
based on Template matching
Use Case – Participatory sensing for
Surveillance
• Reduction in Video Compression
computation Complexity
• Innovative sampling strategy
Collaboration with ISI, Kolkata

15. 14
Analog Video multiplexing and metadata insertion
internet
Use Case – Distance Education System
• Designed for Bandwidth / spectrum
constrained environments
• Crowd-sourced lecture content generation
• Multimedia over Broadcast and
Interactivity over Internet with innovative
synchronization scheme
• Multiplexing of multiple video lectures and
audio in a single video stream
• Insertion of Metadata within analog video
Collaboration with IIT, Kharagpur

16. 15
Electrical Load Analytics
Use Case – Home / Building Energy Gateway
for Appliance level energy consumption
detection
• Multi-protocol Gateway compliant to
multiple standards
• Appliance Identification from aggregated
meter data using source separation
• Demand-response and load-scheduling
• Smart-grid monitoring
• Carbon-footprint Analytics
Collaboration with IIT, Mumbai

17. 16
Power-efficient wireless Mesh Network
Use Case – Mobile Agro-advisory system
• Real-time sending of Soil Temperature,
Soil Moisture, Atmospheric Temperature
and Atmospheric Humidity
• Cellular Backhaul
• Zigbee based wireless mesh network
• Power-efficient sleep mode design

18. 17
Multimodal Event Filtering and Response Planning
Filter with city soundscape info
Heat-map based on participatory sensing
Categorize traffic noise, gunshot or explosion
Filter with social network analysis
NLP and Semantic analysis of geo-coded
social n/w tweets
Filter with local participatory surveillance
- Event triggered participatory sensing
reduced false alarm
Events from video
surveillance system
Fusion of information
Use Case – City Surveillance System
Issue with existing audio / video surveillance systems
• Too many false alarms on events
• Audio sensors are static and hence not pervasive
Emergency ResponsePlanner
Scalable, Adaptable, with plan execution monitoring
and real-time plan revision

19. 18
Large Scale Storage
Use Case – Large Scale
Surveillance Video Storage for
safe city
• Scalable, peta-byte scale
storage for video and audio
tracks and event meta data
• Web services based
standardized interfaces
• Rich query interface
TCS NVR
Internet /
WAN
Event in XML, Video
Camera Controls,
Camera Receiving
Live View
Network Video Storage
NVT
RTSP URI
Video/Audio Track &
Metadata – Camera
ID, Loc, Tilt/Pan
Camera Controls,
Camera Receiving
Live View
NVA
RTSP URI
Video/Audio Track &
Metadata – Event XML
NVT
Receiving
NVS
Receiving
TCS NVR Interface
ONVIF 1.2 Interface
NVT/NVA
ONVIF 2.0 Interface
NVT/NVA
Other standard
Interface like PISA
Device Management, Device Discovery
Recording, Receiving
Query
SOS
Geospatial DB, Key value Store
BLOB Store
Object Store
Server & Storage Farm
SES
N
V
D
NVR – Network Video Recorder
NVD – Network Video Display
NVT – Network Video Transmitter
NVA- Network Video Analyzer
NVS – Network Video Storage
SOS- Sensor Observation Services
SES – Sensor Event Services
ONVIF – Open Network Video Interface Forum
Live Event SubscriberStored Event Viewer

20. 19
Non-parametric Statistical Processing on Big data
Local end patient display
ECG Ultrasound Blood Pressure Viscope
Instrument
Control
Remote End
(Home / Medical Camps)
Patient
ECG
USG
ViScope
Camera
Modem Console
Microphone
Display
Medical
Repository
Internet
Internet
Internet
Live
Session
Recorded
Session
Expert End
(Hospital/Doctor’s clinic)
Use Case – Remote Medical
Consultation, Continuous
Patient Monitoring, Push-based
Patient Alerts
• Multi-protocol Gateway
(device / mobile)
• Relation Pattern /
Clustering from Patient
medical sensor data
• Rule Engine to send pro-
active alerts
• Augmentation of
secondary feeds (e.g.
weather, pollution level
etc.0
• Integration with Clinical
Decision-support System

21. 20
Frugally-engineered ubiquitous devices
Home Infotainment Platform
• Over-the-top STB
• Mash-up of Internet content with
Broadcast content
• Infotainment, Banking and Hotel
Applications
• Also used for Home Energy Gateway,
Medical Gateway and Distance Education
ECG Monitors
• 3-lead wearable and 12-lead portable ECG
monitors
• Continuous monitoring for a prolonged
period for preventive as well as post-
hospitalization care

22. Thank You
arpan.pal@tcs.com