lex fridman mit
Lex Fridman
I'm a research scientist at MIT, working on deep learning in the context of semi-autonomous vehicles, driver state sensing, scene perception, motion control and planning.

Recent News

MIT 6.S094: Deep Learning for Self-Driving Cars

A course on the practice of deep learning explored through the theme of building a self-driving car. Course page is http://selfdrivingcars.mit.edu. Besides lectures and guest talks, it included a deep reinforcement learning competition (DeepTraffic) and an end-to-end driving simulation (DeepTesla).

Select Videos: Research, Demos, and Talks

A talk at TMC Connect 2016 on our use of computer vision to extract the state of the vehicle, the driver, and the external world during naturalistic use of Autopilot in Tesla vehicles.
A demonstration of our gaze region classification algorithm on five synchronized video streams in a Tesla while transfering control to Autopilot and taking control back.
We present a method for detecting driver frustration from both video and audio streams captured during the driver's interaction with an in-vehicle voice-based navigation system.
This is a demo for our automated synchronization algorithm for driving data that uses vibration and steering events to sync driving data within 13ms precision.


MIT Autonomous Vehicle Technology Study: Large-Scale Deep Learning Based Analysis of Driver Behavior and Interaction with Automation
Authors: Fridman, Brown, Glazer, Angell, Dodd, Jenik, et al.
Journal: IEEE Access
Arguing Machines: Perception-Control System Redundancy and Edge Case Discovery in Real-World Autonomous Driving
Authors: Fridman, Jenik, Reimer
Conference: AAAI
DeepTraffic: Driving Fast through Dense Traffic with Deep Reinforcement Learning
Authors: Fridman, Jenik
Conference: AAAI
Designing Toward Minimalism in Modern Vehicle HMI
Authors: Kindelsberger, Fridman, Glazer, Seppelt, Reimer
Conference: CHI
Road Curvature with Tesla Autopilot: Difference in Approach between Human and Machine
Authors: Brown, Fridman, Kindelsberger, Glazer, Reimer
Conference: CHI
Cognitive Load Estimation in the Wild
Authors: Fridman, Reimer, Mehler, Freeman
Conference: CHI
Understanding Non-Verbal Communication Between Vehicles and Pedestrians Toward Safer Automated Vehicles
Authors: Toyoda, Fridman, Jenik, Mehler, Reimer
Conference: FAST-Zero
What Can Be Predicted from 6 Seconds of Driver Glances?
Authors: Fridman, Toyoda, Seaman, Seppelt, Angell, Lee, Mehler, et al.
Conference: CHI
Semi-Automated Annotation of Discrete States in Large Video Datasets
Authors: Fridman, Reimer
Conference: AAAI
SideEye: A Generative Neural Network Based Simulator of Human Peripheral Vision
Authors: Fridman, Jenik, Keshvari, Bryan, Reimer, Zetzsche, et al.
Conference: CHI
Owl and Lizard: Patterns of Head Pose
and Eye Pose in Driver Gaze Classification
Authors: Fridman, Lee, Reimer, Victor
Journal: IET Computer Vision
Automated Synchronization of Driving Data
Using Vibration and Steering Events
Authors: Fridman, Brown, Angell, Abdic, Reimer, Noh
Journal: Pattern Recognition Letters
Learning Human Identity From Motion Patterns
Authors: Neverova, Wolf, Lacey, Fridman, Chandra, Barbello, et al.
Journal: IEEE Access
Driver Gaze Region Estimation without Use of Eye Movement
Authors: Fridman, Langhans, Lee, Reimer
Journal: IEEE Intelligent Systems
Driver Frustration Detection from Audio and Video in the Wild
Authors: Abdic, Fridman, McDuff, Marchi, Reimer, Schuller
Conference: IJCAI
Investigating Drivers' Head and Glance Correspondence
Authors: Lee, Munoz, Fridman, Victor, Reimer, Mehler
Journal: PeerJ
Detecting Road Surface Wetness from Audio: A Deep Learning Approach
Authors: Abdic, Fridman, Marchi, Brown, Angell, Reimer, Schuller
Conference: ICPR
A Framework for Robust Driver Gaze Classification
Authors: Fridman, Lee, Mehler, Reimer
Conference: SAE World Congress
Behavioral Impact of Drivers' Roles in Automated Driving
Authors: Reimer, Pettinato, Fridman, Lee, Mehler, Seppelt, Park, et al.
Conference: AutomotiveUI
Distinguishing Patterns in Drivers' Visual Attention Allocation
Using Hidden Markov Models
Authors: Munoz, Reimer, Lee, Mehler, Fridman
Journal: Transportation Research Part F
Multi-modal Decision Fusion for Continuous Authentication
Authors: Fridman, Stolerman, Acharya, Brennan, Juola, Greenstadt, et al.
Journal: Computers and Electrical Engineering
Active Authentication on Mobile Devices
via Stylometry, Application Usage, Web Browsing, and GPS Location
Authors: Fridman, Weber, Greenstadt, Kam
Journal: IEEE Systems Journal
On the Joint Impact of Bias and Power Control on Downlink Spectral Efficiency in Cellular Networks
Authors: Fridman, Wildman, Weber
Journal: IEEE/ACM Transactions on Networking
Active Linguistic Authentication Using Real-Time
Stylometric Evaluation for Multi-Modal Decision Fusion
Authors: Stolerman, Fridman, Greenstadt, Brennan, Juola
Conference: Advances in Digital Forensics
Decision Fusion for Multimodal Active Authentication
Authors: Fridman, Stolerman, Acharya, Brennan, Juola, Greenstadt, et al.
Journal: IEEE IT Professional
User Authentication Through Biometric Sensors and Decision Fusion
Authors: Acharya, Fridman, Brennan, Juola, Greenstadt, Kam
Conference: CISS
Observations on Sum User Rate for Cellular Downlink
Authors: Fridman, Wildman, Weber
Conference: CROWNCOM
OMAN: A Mobile Ad Hoc Network Design System
Authors: Fridman, Weber, Graff, Breen, Dandekar, Kam
Journal: IEEE Transactions on Mobile Computing
Cross-Layer Multicommodity Capacity Expansion
on Ad Hoc Wireless Networks of Cognitive Radios
Authors: Fridman, Weber, Dandekar, Kam
Conference: CISS
Cooperative Surveillance in Video Sensor Networks
Authors: Fridman, Primerano, Weber, Kam
Conference: ICDSC
A Simplification Algorithm for Visualizing
the Structure of Complex Graphs
Authors: Hennessey, Brooks, Fridman, Breen
Conference: International Conference on Information Visualisation
Distributed Path Planning for Connectivity Under Uncertainty
by Ant Colony Optimization
Authors: Fridman, Weber, Kumar, Kam
Conference: American Control Conference (ACC)
Communication-Based Motion Planning
Authors: Fridman, Modi, Weber, Kam
Conference: CISS
Path Planning for Network Performance
Authors: Fridman, Weber, Graff, Kam
Conference: GLOBECOM
Visualization of Resource Allocation
in Large-Scale Mobile Ad Hoc Networks
Authors: Fridman, Hennessey, Breen, Weber, Kam
Conference: ISVC
Robust Optimal Power Control for Ad Hoc Networks
Authors: Fridman, Grote, Weber, Dandekar, Kam
Conference: CISS