Provide more delicate and user friendly facilities in computing devices .Gap between the electronic and physical world is reduced. The computers can be run using implicit commands instead of…Full description
A fingerstyle arrangement of Behind Blue Eyes as made famous by Limp Bizkit
Limp Bizkit - Behind Blue Eyes [Guitar Tab]
MVFV,G,Descripción completa
Sheet music
Full description
Dark Eyes music bookFull description
wayne shorter
eyesDescrição completa
Análisis del montaje de la película Snake Eyes (Brian de Palma, 1998)Descripción completa
Descripción: spanish
Description complète
angel eyes sheet musicDescription complète
dry eyeFull description
Description complète
Full description
B l u e e e t e c h n ol o ( blue eyes – Human operator monitoring system )
BY
Agenda n n n n n n n n n n
Motivation What is BlueEye technology ? What is BlueEyes ? System designing System overview DAU CSU Data security IBM research Conclusion
Motivation n
Human error - a frequent reason of catastrophes and ecological disasters –
temporal indisposition
weariness – oversight Monitoring of conscious –
•
•
Lack of complex solution exploiting wireless link technology,, database systems and AI algorithms technology
What is blue eye technology ? n
The BLUE EYES technology aims at creating computational machines that have perceptual and sensory ability like those of human beings.
How can we make computers “see” and n
n
Blue eyes uses sensing technology to identify a user’s actions and to extract key information. Information is then analyzed to determine the user’s physical ,emotional ,or informational state.
What is n
?
The complex solution for humanoperator monitoring: – – – –
Visual attention monitoring Physiological condition Operator’s position detection
What is BlueEyes not? n
n
Doesn’t predict nor interfere with operator’s thoughts Cannot force directly the operator to work
IBM research BLUE EYE – EMOTIONAL MOUSE sensors in the mouse ,sense the physiological attributes which are correlated to emotions using correlation model -by simply touching the mouse ,the computer will be able to determine a person’s emotional state. n BLUE EYE enabled TELEVISION – could become active when the user makes an eye contact. n
Physiological foundations Human brain
Preconscious brain • •
alogical „automatic”
Conscious brain • • •
manages the knowledge logical reasoning makes decisions
Conscious brain - operation
Exploratory mode
Planning mode
The eye movement sensor n
n
-
-
Off-shelf eye movement sensor – Jazz multisensor Supplies raw digital data regarding Eye position Level of blood oxygenation Acceleration along horizontal and vertical axes Ambient light intensity
Eye movements •
Retina - central vision (macula)
•
Central vision and the conscious brain
Saccade - a rapid eye jump to a new location assigned by the conscious attention process.
Saccades presence
Exploratory mode
Jazz multisensor
Jazz Multisensor
Jazz
Design objectives n
A mobile data acquisition device
•
A reliable r eliable real-time buffering, processing and recording A clear visualizatio visualization n interface Mechanisms for creating custom data analyzers To ensure a possibility of distributing the processing among a number of computers
• •
•
Implementation Implementation and engineering -THREE groups of users n OPERATOR -a person whose physiological parameters are supervised - authorization in the system - receiving alerts n SUPERVISOR – a person responsible for analyzing operator’s condition and performance. n SYSTEM ADMINISTRATORS- maintains the system deliver tools for adding - new operator’s to the database - defining alarm conditions - configuring logging tools - cr crea eattin new anal ze zerr mod odu ule les s
Designing A personal area network for linking all the operators and the supervising system n Two major units - DAU (data acquisition unit ) - CSU (central system unit ) n
System overview Data Acquisition Unit Atmel 89C52 microcontroll
Bluetoot
Central System Unit Bluetoo
Connection Manager
Visualizati on
Data Analysis
Data Logger
Jazz Multisensor
Bluetooth technology provides
means for creating a Personal Area Network linking the operators and the central s stem.
DAU The DAU consists of the following components n ATMEL 8952 microcontroller n BLUE TOOTH MODULE – supports synchronous voice data transmission n PCM CODEC –used to transmit operator’s voice and central system sound feedback n UART –communication between bluetooth module and microcontroller (115200 bps) n MAX232 –level shifter n ALPHAUNUMERIC LCD display n LED indicators n ID CARD interface
DAU - features is
Data Acquisition Unit n
Atmel 89C52 microcontroll
Bluetoot
n
Jazz Multisensor
n
n
Lightweight Runs on batteries low power consumption Easy to use - does not disturb the operator working ID cards for operator authorization
DAU - components microphone
MC 145483 PCM codec
earphone
Bluetoot h
Jazz Beeper LCD display
Atmel 89C52 microcontroller
T R A U
UART
MAX2 32
LED indicators
BlueEyes ID card interface ID card
Simple keyboar
Data Acquisition Unit
Microcontroller & blue tooth module
EEPROMS & the PCB
Implementation - DAU n •
Made from scratch by the team
Bluetooth module inside n Jazz sensor interface n Microphone and earphone sockets n 5-key keyboard n Two lines, 8 characters LCD n Powered from 6 AA batteries n
Implementation - DAU PCM codec board
Microcontroller board
Batteries and module voltageBluetooth level monitor
CSU - features n
n
n n n
n
Connection management Data processing Visualization Data recording Access verification
Central System Unit
Bluetoo
Connection Manager
Visualizati on
Data Analysis
Data Logger
CSU – components n
n
n
n
CONNECTION MANAGER – main task to perform low-level blue tooth communication DATA ANALYSIS MODULE – performs the analysis of the raw sensor data in order to obtain information about operator’s physiological condition DATA LOGGER MODULE – provides support for storing the monitored data. VISULAIZATION MODULE – provides user interface for the supervisors
CSU - Visualization Module n
Raw and processed data visualization u si n : – – –
n
VU-meters pie-charts time series
audio and video data playback
CSU - saccade detector n
Saccade detector and conscious brain involvement level calculation Eye movement velocity
Raw eye movement data
250
y t i c o l e V
200 150 100 50 0 -50 -100 -150 -200 -250
Differentiation
0
8000
16000
2400 0
32000
Time [ms]
Visual attention level 60
) a v 50 L ( l 40 e v e 30 l n o i 20 t n e t 10 t A
Conscious brain involvement level
0
0
8000
16000
Time [ms]
24000
32000
CSU - Connection Manager Operator Data Manager
•
Initializes Bluetooth
Data demultiplexer modules •Data producer queues •
Inquires for new devices in range Raw connections • Separated Establishes Data Operator • Supports operator Manager roamingAlert Alerts • Feeds Operator Manager with...physiological data ... •
Bluetoo
... ...
Bluetoo
Bluetooth Connection Manager
Operator Manager
Raw Data Alert
Alerts
CSU - Data Analysis •
Custom data analyzers - decision tree based classifiers cl assifiers
•
Automatic decision tree coefficients generation - C4.5 based algorithm
Data samples
Assigned category “Yes”
...
No ... answer “Yes” “No” No answer
Decision tree coefficients
CSU - Data Analysis n
Custom data analyzers - decision tree based classifiers Example: Operator gesture recognition (simplified) Vertical Acceleration variance value high Horizontal Acceleration variance high
Y Horizontal Acceleration variance high
Y “YES”
N
No answer
Y “NO”
CSU - intermodule communication n
Uses buffered thread-safe queues and producer-consumer producer-consum er scheme register at
Data consumer
creates
Data producer
Data queue
Data Data consumer & Processing consumer producer
Data Data consumer & Processing consumer producer
D ata q ueu e D ata q ueu e
Data consumer
CSU - intermodule communication Connection Connection Manager Manager
OOppeera rato torrm maannaaggeerr
Alerts
Data DataAnalysis Analysis
... ...
OO
OO
Separated physiological data streams
Visualization Visualization Module Module
Processed data
Recorded (off-line) data
Data Logger
Implementation - CSU •
Standard MDI user interface
n
Custom-built Bluetooth communication routines Intel USB camera ID card programmer Developed using Visual C++ 6.0 Deployment environment: Windows 2000, MS SQL Server
n n n n
Future im rovements DAU small CMOS camera to monitor the operator’s point of gaze single PCB (SMD technology) low voltage ICs - LiIO batteries power CSU data mining algorithms advanced database encryption using e.g. AES algorithm
Data security n
n n n n
Only registered mobile devices can connect to the system Bluetooth connection authentication Bluetooth connection encryption Access rights restrictions Personal and physiological data encryption
n
Generic control rooms
(System can be applied in every working environment requiring permanent operator’s attention) – Power station – Captain bridge – Flight control centers – O eratin theatres – anesthesiolo ists
- benefits n
Prev even enti tion on fr from om da dan n er erous ous in inci cide dent nts s incid inc iden ents ts
n
Minimization of – – –
n
ecological consequenc c onsequences es financial loss a threat to a human life
The reconstruction of the course of o erator’s work
In the near future ,ordinary household devices- such as television , refrigerators ,ovens may be able to do their jobs when we look at them and speak to them. Future applications of blue eye technology is limitless
