Link to his blog post with construction details, schematics and code can be found here: How David Singleton built a neural network controlled self-driving (RC) car!

Link to his G+ post and comments

Updated January 2nd: the source code is now open source and available on github.

Video of car in action: http://www.youtube.com/watch?v=ndSiW9Zmd6g

The system consists of:

  • Android phone — mounted on the car, captures video frames of the road ahead using its built-in camera at ~15 fps. An app running on the phone connects to a server running on a laptop computer via wifi and streams 176x144 grayscale video frames across the connection.

  • Computer — runs a little Java app called "Driver" which acts as both a TCP server, receiving streamed image frames from the phone and a user interface allowing a human driver to control the car with the cursor keys or mouse. In record mode, the video frames are saved to disk, labelled with the current control input coming from the human driver. The neural network is trained using these labelled frames in a separate environment on the computer. Trained parameters are saved out to files which are in turn read by the Driver app... which in auto mode can feed incoming video frames directly to the neural network and steer according to its predictions, by sending instructions over a serial interface connected to an...

  • Arduino Uno — connected to the computer via USB and hacked to connect to and simulate keypresses on the car's radio controller PCB (as described below).

asked 04 Jan '12, 13:42

Gundega's gravatar image


edited 22 Feb '12, 12:04

Nice work!
(04 Jan '12, 14:18) AchilleTalon AchilleTalon's gravatar image
Thanks for sharing this :)
(05 Jan '12, 07:51) Merlin Merlin's gravatar image
This couldn't be more outstanding if it tried. Thanks for sharing this link, Gundega.
(22 Feb '12, 12:59) smjohns smjohns's gravatar image

Additional resources on same topic, brought to you via article on hackaday.com


answered 04 Jan '12, 17:10

Gundega's gravatar image


the second link seems to be down.
(22 Feb '12, 13:33) EdK ♦ EdK's gravatar image
Their site seems to be down right now
(22 Feb '12, 13:48) Gundega Gundega's gravatar image
Your answer
toggle preview

Follow this Question via Email

Once you sign in you will be able to subscribe for any updates here

Q&A Editor Basics

  • to upload an image into your question or answer hit
  • to create bulleted or numbered lists hit or
  • to add a title or header hit
  • to section your text hit
  • to make a link clickable, surround it with <a> and </a> (for example, <a>www.google.com</a>)
  • basic HTML tags are also supported (for those who know a bit of HTML)
  • To insert an EQUATION you can use LaTeX. (backslash \ has to be escaped, so in your LaTeX code you have to replace \ with \\). You can see more examples and info here