lex fridman
Lex Fridman
I'm a postdoc at MIT. Contact me at fridman@mit.edu
My research interests are in developing and applying deep neural networks in the context of driver state sensing, scene perception, and shared control of semi-autonomous vehicles.

Recent News

MIT 6.S094: Deep Learning for Self-Driving Cars

A course on the practice of deep learning explored through the theme of building a self-driving car. Besides lectures and guest talks, it included a deep reinforcement learning competition (DeepTraffic) and an end-to-end driving simulation (DeepTesla). Course page: http://cars.mit.edu

Select Videos: Research, Demos, and Talks

A talk at TMC Connect 2016 on our use of computer vision to extract the state of the vehicle, the driver, and the external world during naturalistic use of Autopilot in Tesla vehicles.
A demonstration of our gaze region classification algorithm on five synchronized video streams in a Tesla while transfering control to Autopilot and taking control back.
We present a method for detecting driver frustration from both video and audio streams captured during the driver's interaction with an in-vehicle voice-based navigation system.
This is a demo for our automated synchronization algorithm for driving data that uses vibration and steering events to sync driving data within 13ms precision.


Cognitive Load Estimation in a Large On-Road Driving Dataset
Authors: Fridman, Reimer, Mehler, Freeman
Conference: CVPR
What Can Be Predicted from 6 Seconds of Driver Glances?
Authors: Fridman, Toyoda, Seaman, Seppelt, Angell, Lee, Mehler, et al.
Conference: CHI
Semi-Automated Annotation of Discrete States in Large Video Datasets
Authors: Fridman, Reimer
Conference: AAAI
A Fast Foveated Fully Convolutional Network Model
for Human Peripheral Vision
Authors: Fridman, Cheema, Wolfe, Zetzsche, Reimer, Rosenholtz
Journal: ACM Transactions on Applied Perception
MIT Bike Vision Dataset: A Computer Vision Approach to Cyclist Safety
Authors: Angell, Fridman, Brown, Dodd, Reimer, Karaman
Conference: Driving Assessment
On the Joint Impact of Bias and Power Control
on Downlink Spectral Efficiency in Cellular Networks
Authors: Fridman, Wildman, Weber
Journal: IEEE/ACM Transactions on Networking
Comparing Near-Infrared and Visible Light
for Gaze Estimation in the Wild
Authors: Brown, Fridman, Angell, Reimer
Journal: Pattern Recognition Letters
Owl and Lizard: Patterns of Head Pose
and Eye Pose in Driver Gaze Classification
Authors: Fridman, Lee, Reimer, Victor
Journal: IET Computer Vision
Automated Synchronization of Driving Data
Using Vibration and Steering Events
Authors: Fridman, Brown, Angell, Abdic, Reimer, Noh
Journal: Pattern Recognition Letters
Learning Human Identity From Motion Patterns
Authors: Neverova, Wolf, Lacey, Fridman, Chandra, Barbello, et al.
Journal: IEEE Access
Driver Gaze Region Estimation without Use of Eye Movement
Authors: Fridman, Langhans, Lee, Reimer
Journal: IEEE Intelligent Systems
Driver Frustration Detection from Audio and Video in the Wild
Authors: Abdic, Fridman, McDuff, Marchi, Reimer, Schuller
Conference: IJCAI
Investigating Drivers' Head and Glance Correspondence
Authors: Lee, Munoz, Fridman, Victor, Reimer, Mehler
Journal: PeerJ
Detecting Road Surface Wetness from Audio: A Deep Learning Approach
Authors: Abdic, Fridman, Marchi, Brown, Angell, Reimer, Schuller
Conference: ICPR
A Framework for Robust Driver Gaze Classification
Authors: Fridman, Lee, Mehler, Reimer
Conference: SAE World Congress
Behavioral Impact of Drivers’ Roles in Automated Driving
Authors: Reimer, Pettinato, Fridman, Lee, Mehler, Seppelt, Park, et al.
Conference: AutomotiveUI
Distinguishing Patterns in Drivers' Visual Attention Allocation
Using Hidden Markov Models
Authors: Munoz, Reimer, Lee, Mehler, Fridman
Journal: Transportation Research Part F
Multi-modal Decision Fusion for Continuous Authentication
Authors: Fridman, Stolerman, Acharya, Brennan, Juola, Greenstadt, et al.
Journal: Computers and Electrical Engineering
Active Authentication on Mobile Devices
via Stylometry, Application Usage, Web Browsing, and GPS Location
Authors: Fridman, Weber, Greenstadt, Kam
Journal: IEEE Systems Journal
Active Linguistic Authentication Using Real-Time
Stylometric Evaluation for Multi-Modal Decision Fusion
Authors: Stolerman, Fridman, Greenstadt, Brennan, Juola
Conference: Advances in Digital Forensics
Decision Fusion for Multimodal Active Authentication
Authors: Fridman, Stolerman, Acharya, Brennan, Juola, Greenstadt, et al.
Journal: IEEE IT Professional
User Authentication Through Biometric Sensors and Decision Fusion
Authors: Acharya, Fridman, Brennan, Juola, Greenstadt, Kam
Conference: CISS
Observations on Sum User Rate for Cellular Downlink
Authors: Fridman, Wildman, Weber
Conference: CROWNCOM
OMAN: A Mobile Ad Hoc Network Design System
Authors: Fridman, Weber, Graff, Breen, Dandekar, Kam
Journal: IEEE Transactions on Mobile Computing
Cross-Layer Multicommodity Capacity Expansion
on Ad Hoc Wireless Networks of Cognitive Radios
Authors: Fridman, Weber, Dandekar, Kam:
Conference: CISS
Cooperative Surveillance in Video Sensor Networks
Authors: Fridman, Primerano, Weber, Kam
Conference: ICDSC
A Simplification Algorithm for Visualizing
the Structure of Complex Graphs
Authors: Hennessey, Brooks, Fridman, Breen
Conference: International Conference on Information Visualisation
Distributed Path Planning for Connectivity Under Uncertainty
by Ant Colony Optimization
Authors: Fridman, Weber, Kumar, Kam
Conference: American Control Conference (ACC)
Communication-Based Motion Planning
Authors: Fridman, Modi, Weber, Kam
Conference: CISS
Path Planning for Network Performance
Authors: Fridman, Weber, Graff, Kam
Conference: GLOBECOM
Visualization of Resource Allocation
in Large-Scale Mobile Ad Hoc Networks
Authors: Fridman, Hennessey, Breen, Weber, Kam
Conference: ISVC
Robust Optimal Power Control for Ad Hoc Networks
Authors: Fridman, Grote, Weber, Dandekar, Kam
Conference: CISS