A computer-implemented method is disclosed for determining optimal operational parameters for a model predictive controller (MPC) for vehicle control. The method includes training a machine learning model by simulating vehicle operations across a range of operational parameters using an MPC…
Systems and methods for optimizing the loading or unloading of cargo in a cargo area is provided. Friction-reducing elements, such as rails, may be disposed atop a surface of the cargo area. The friction-reducing elements vibrate pursuant to the application of vibrational energy generated by one or…
Systems and methods described herein relate to self-supervised scale-aware learning of camera extrinsic parameters. One embodiment processes instantaneous velocity between a target image and a context image captured by a first camera; jointly training a depth network and pose network based on…
A system includes sensors that determine one or more attributes associated with associated with an occupant within a vehicle. The system includes one or more datastores, one or more processors, and a memory storing instructions that, when executed by the one or more processors, cause the system to…
Systems and methods actuate torque vectoring and independent wheel steering control capabilities of an over-actuated vehicle in order to compensate for instability in potentially dangerous driving scenarios, such as during towing of the over-actuated vehicle. The disclosed vehicle stabilization…
Systems and methods are provided for a carbon footprint aware V2H system that supplies power from a vehicle to a household based on a carbon footprint of an electrical transmission grid connected to the household. Examples herein electrically connect a vehicle power system to a household power…
A method for an online, task-aware opponent modeling in autonomous racing is described. The method includes concurrently training an opponent-aware policy and an opponent-aware encoder using reinforcement learning. The method also includes calculating, by the opponent-aware encoder, opponent…
A method for regulating an affective state of a driver includes transmitting, to a remote monitoring system, vital sign data of the driver in accordance with monitoring one or more vital signs of the driver. The method also includes receiving, from the remote monitoring system, haptic feedback data…
A method for a driver prediction system is described. The method includes training a neural network to a learn a set of polynomial basis functions. The method also includes selecting, using a trained neural network, a learned polynomial basis function to perform a prediction of an action of an…
A method for a replay driver skill improvement system is described. The method includes logging vehicle commands requested by a vehicle operator of an ego vehicle to perform a selected driving maneuver. The method also includes identifying one or more of the logged vehicle commands in which…
Systems and methods are provided for determining vehicle configurations. The system can receive simulation data or actual driving data of a driving track corresponding to a driver and associate the simulation data or actual driving data with one or more driving parameters. A driver style can be…
Systems and methods described herein relate to self-supervised scale-aware learning of camera extrinsic parameters. One embodiment processes instantaneous velocity between a target image and a context image captured by a first camera; jointly training a depth network and pose network based on…
Systems and methods of using a common control scheme to autonomously controlling a vehicle during two different autonomous driving modes are provided. In particular, embodiments of the presently disclosed technology incorporate reference tracking for driving input and vehicle state into this common…
A method for triggering capture of diverse driving data from captions is described. The method includes training a discriminator network to identify similarities between a received text description and a received scene description. The method also includes feeding a trained discriminator network…
Systems and methods provide for corrective assistance to maintain a stable controllable drift, while permitting a drift driving experience for the driver. Examples of the systems and methods disclosed herein include receiving first data corresponding to a current operational state of a vehicle…
A method for scale-aware depth estimation using multi-camera projection loss is described. The method includes determining a multi-camera photometric loss associated with a multi-camera rig of an ego vehicle. The method also includes training a scale-aware depth estimation model and an ego-motion…
A method for interacting with an object includes identifying, via a keypoint classifier, one or more uncertainty regions in an environment based on an estimated trajectory of an object in the environment. The method also includes planning an interaction with the object based on identifying the one…
Systems and methods for enhanced end-to-end three-dimensional (3-D) object detection are disclosed that improve detecting objects in the 3D space from images, such as monocular camera image that may be captured during the operation the autonomous vehicles. For example, a vehicle can include a…
Systems and methods for enhanced computer vision capabilities, particularly including depth synthesis, which may be applicable to autonomous vehicle operation are described. A vehicle may be equipped with a geometric scene representation (GSR) architecture for synthesizing depth views at arbitrary…
A method estimating a depth of an environment includes generating, via a cross-attention model, a cross-attention cost volume based on a current image of the environment and a previous image of the environment in a sequence of images. The method also includes generating, via the cross-attention…
Systems and methods for trajectory planning for an autonomous vehicle, may include: computing features for each of the plurality of candidate trajectories; computing scores for the features of the candidate trajectories, wherein the scores are based on parameter values associated with their…
Systems and methods are provided for developing/updating training datasets for traffic light detection/perception models. V2I-based information may indicate a particular traffic light state/state of transition. This information can be compared to a traffic light perception prediction. When the…
A method for controlling a vehicle in an environment includes generating, via a cross-attention model, a cross-attention cost volume based on a current image of the environment and a previous image of the environment in a sequence of images. The method also includes generating combined features by…
Systems and methods are provided for dynamic driver training, and may include: a communication interface to receive sensor data, the sensor data comprising driver biometric data and driver performance data for a driver operating a vehicle; a driver inference circuit to infer a skill level and…
A method for an electric vehicle trip simulator is described. The method includes determining parameters for an upcoming trip of an electric vehicle, including at least a start location and a destination location. The method also includes analyzing data associated with a plurality of points of…
Systems and methods of model or prediction algorithm selection are provided. An autonomous control system may include a perception component that, based on environmental inputs regarding an object(s), a vehicle's operating characteristics, etc., outputs a current state of the vehicle's surrounding…
A method of representation learning for object detection from unlabeled point cloud sequences is described. The method includes detecting moving object traces from temporally-ordered, unlabeled point cloud sequences. The method also includes extracting a set of moving objects based on the moving…
A method for indicating occlusion information at an ego agent includes observing a spatial area from a first viewpoint of one or more first sensors associated with the ego agent. The method also includes identifying the spatial area as an occluded area in accordance with observing the spatial area…
Systems and Methods for controlling an autonomous vehicle, may include: receiving sensor data, the sensor data comprising vehicle parameter information for the autonomous vehicle; using the sensor data to determine a vehicle state for the autonomous vehicle, wherein the vehicle state comprises…
Systems and methods for use of operator state conditions to generate, adapt or otherwise produce visual signals relaying information to the operator are disclosed. A monitoring system may observe and analyze a vehicle operator to determine an operator state. The monitoring system may transmit the…