| Home |
| Overview |
| Screenshots |
| Documentation |
| Downloads |
| Publications |
| Links |
Welcome to the iLab Neuromorphic Vision C++ Toolkit (iNVT)!
The iLab Neuromorphic Vision C++ Toolkit (iNVT, pronounced ``invent'') is a comprehensive set of C++ classes for the development of neuromorphic models of vision. Neuromorphic models are computational neuroscience algorithms whose architecture and function is closely inspired from biological brains. The iLab Neuromorphic Vision C++ Toolkit comprises not only base classes for images, neurons, and brain areas, but also fully-developed models such as our model of bottom-up visual attention and of Bayesian surprise.
|
|
|
Features at a glance:
- The source tree is maintained using the Subversion (SVN) revision control system.
- The main development platform is Linux. However, the core programs also compile under Windows (using cygwin) and MacOS X.
- All source code is distributed freely under the GNU General Public License. Registered users get access to our central SVN source code repository and hence receive updates in real-time, not only when we make major releases.
- Low-level helper classes, including Point2D, Rectangle, PixRGB<T>, Range, Timer, XWindow, etc.
- Template Image<T> and ImageSet<T> classes with hundreds of image processing functions and copy-on-write / ref-counting semantics.
- Image I/O functions for read/write to image files (PNM or PNG) or video streams (various formats).
- Low-level neural network simulation classes, such as LeakyInterator and LeakyIntFire neurons and backprop perceptron classes.
- High-level neuromorphic classes, including a hierarchy of low-level visual feature Channels for the computation of neural maps responding to color, intensity, orientation, motion, corners, T-junctions, etc; a Winner-Take-All maximum selector network; a Saliency Map network to represent conspicuous locations in a visual scene; a Visual Buffer short-term visual memory endowed with internal competitive dynamics; a Visual Cortex class that orchestrates the computations of a variable collection of feature channels; a Brain class that holds a Visual Cortex, Saccade Controller for the simulation of eye/head movements, Task-Relevance Map to memorize locations of interest in a scene, Shape Estimator to roughly segment objects in a scene, a set of SIFT classes that implement David Lowe's Scale-Invariant Feature Transform model for object/scene recognition, etc.
- Neuromorphic models of visual attention (to find locations in an image or video stream that are likely to attract the eyes of a human observer or to surprise the observer), contour integration (to simulate how elongated contours are strong attractors of attention in human observers), object recognition (using various strategies including matching feature vectors, backprop perceptrons, hierarchical feedforward feature extraction models, etc), intelligent knowledge-based vidual agents that perform high-level scene understanding, rapid computation of the ``gist'' or coarse semantic category of an entire scene (e.g., indoors vs. outdoors), and many more!
- Hardware interfacing, to Video4Linux and IEEE-1394 (FireWire) cameras, audio/dsp, serial ports, serial servo controllers, GPS units, etc. This only works under Linux.
- Parallel processing classes for the simulation of complex models over Beowulf clusters of computers.
- Neuromorphic modeling environment which facilitates the run-time selection of plug-in model components, the management of persistent model tuning parameters, and the generation/parsing of command-line options for various models based on the collection of model components which they implement.
- And much, much more...
The iLab Neuromorphic Vision C++ Toolkit is one of the many exciting neuromorphic vision research projects from the iLab at the University of Southern California.
Current Status
Recent SVN and Forum activity, ordered by last SVN commit date/time.
| User | Last SVN Commit | Last iLab Forum Post | |||
 | kai | 2012-05-22 at 13:00:37 | M trunk/saliency/src/Robots/Beobot2/LaneFollowing/RG_Lane/RG_Lane2.C | 15295 | --- |
 | nnoori | 2012-05-21 at 23:43:08 | M trunk/nnoori/papers/vsstm/paper.tex | 4445 | Sun Feb 10 23:27:12 2008 |
 | lior | 2012-05-21 at 18:30:13 | M trunk/lior/projects/EdgeLabeling/src/fastspaf2.0/Gauss.cpp | 4442 | --- |
 | borji | 2012-05-21 at 17:29:35 | M trunk/borji/papers/ExplicitSaliency/report.tex | 4440 | --- |
 | masatoshi | 2012-05-21 at 17:28:04 | A trunk/itti/papers/2010_Lesion/cover3.doc | 4439 | --- |
 | itti | 2012-05-21 at 09:39:55 | M trunk/itti/papers/2010_Lesion/Supplementary.doc | 4436 | Wed May 9 09:22:25 2012 |
 | pohetsn | 2012-05-18 at 21:08:32 | A trunk/pohetsn/projects/2010_patient_james/code/matlab3/xticklabel_rotate.m | 4435 | --- |
 | beobot | 2012-05-18 at 20:48:08 | M trunk/saliency/src/Devices/IMU_MicroStrain_3DM_GX2.C | 15293 | --- |
| shane | 2012-05-17 at 18:08:36 | A trunk/shane/papers/SalientGreen/camera_ready/Grant.pdf | 4429 | --- |
| jshen | 2012-05-17 at 16:54:22 | M trunk/nrtilab/src/Algorithms/Learn/CRFComponent.H | 820 | --- |
| dparks | 2012-05-15 at 14:51:30 | M trunk/nrtneo2/Modules/Attention/HueBasedObjectDetector/HueBasedObjectDetectorModule.C | 1147 | Mon Sep 1 10:18:18 2008 |
 | binh | 2012-05-14 at 08:50:11 | M iLab Weekly Tasks/iLab-Weekly-Tasks-2012.xlsx | 1020 | --- |
 | sophie | 2012-05-09 at 09:50:15 | M trunk/nrtilab/src/Algorithms/Evaluation/ScoreAttentionBiasComponent.C | 818 | Tue Jul 13 11:17:54 2010 |
 | dberg | 2012-05-08 at 15:51:21 | A trunk/dberg/projects/monkey_sc/analysis/matlab/analysis/compareModels.m | 4399 | --- |
 | rand | 2012-05-04 at 20:23:01 | M trunk/nrtneo2/Algorithms/Attention/SimpleAttention.C | 1144 | Tue May 12 22:57:00 2009 |
 | farhan | 2012-04-23 at 14:57:33 | A trunk/farhan/work/ssvep/combineData.m | 4336 | Mon Sep 25 10:30:51 2006 |
| ilink | 2012-04-13 at 21:48:06 | M trunk/saliency/src/AppPsycho/psycho-triple-spatial-distractor-control.C | 15251 | --- |
 | tammt | 2012-04-04 at 17:02:33 | M Reimbursements/Log.xlsx | 1001 | --- |
 | dicky | 2012-03-30 at 15:26:41 | A trunk/dicky/papers/Draft_Paper_1-LI.odt | 4220 | --- |
 | debra | 2012-03-15 at 18:09:07 | A trunk/debra/projects/2012_color_harmony/stimuli_pair.m | 4108 | --- |
| kavi | 2012-02-24 at 18:16:01 | M trunk/nrtilab/depoptions.in | 783 | --- |
| ekaszubski | 2012-02-13 at 22:51:41 | M trunk/nrt/include/nrt/Robotics/TransformManager.H | 1508 | Wed Sep 23 16:22:44 2009 |
 | siagian | 2012-01-31 at 19:18:37 | M trunk/saliency/src/Robots/Beobot2/LaneFollowing/AppearanceContrastTrailRecognizer.C | 15144 | --- |
| testsuite | 2011-12-13 at 18:00:12 | M brown_classifiers/111110-heli_classifiers/files_extracted_from_800_chips_per_class/model.mat | 181 | --- |
| helga | 2011-11-29 at 23:51:14 | A trunk/dberg/papers/adaptation_slice/model.png | 3525 | --- |
 | pez | 2011-11-18 at 12:00:10 | M trunk/nrtneo2/Scripts/matlab/convertAllToDarpaCSV.m | 1111 | --- |
| iroll | 2011-11-14 at 15:30:38 | M trunk/neovision2/systemfiles/calibration/dpm-helitrain-truck.cal | 172 | --- |
| ilab31 | 2011-11-09 at 18:22:01 | M trunk/saliency/src/AppPsycho/psycho-triplecounting.C | 15057 | --- |
| igpu | 2011-11-03 at 13:58:31 | M trunk/nrtneo2/Scripts/FinalScripts/tower.py | 1005 | --- |
| tbocs | 2011-10-17 at 23:30:17 | M trunk/nrtilab/src/Messages/Robotics/LaserScanMessage.H | 697 | --- |
| igpu2 | 2011-10-12 at 21:22:53 | A trunk/nrt/include/nrt/Core/Memory/Allocation.H | 1385 | --- |
| montalbo | 2011-08-17 at 15:56:23 | D trunk/nrt/src/Apps/nrtDesigner/ModuleLibrary.C | 1251 | --- |
| irock | 2011-08-12 at 18:16:37 | M trunk/nrtilab/src/Algorithms/ImageProc/cvBlobs/BlobDetectionComponent.C | 523 | --- |
| ekaszbuski | 2011-04-18 at 14:06:46 | M trunk/nrt/src/nrt/ImageProc/IO/ImageSource/MgzJImageSource.C | 633 | --- |
 | ilab19 | 2011-04-14 at 09:38:07 | M trunk/saliency/src/AppPsycho/psycho-narrator.C | 14729 | --- |
| ehu | 2011-03-01 at 14:03:17 | M trunk/saliency/Data/SamplesConfig.xml | 14560 | --- |
 | manu | 2011-02-08 at 10:35:09 | M trunk/mviswana/thesis/ | 2524 | --- |
| sreedhar | 2011-02-07 at 21:54:19 | A trunk/nrt/include/nrt/ImageProc/IO/ImageSource/PfmImageSource.H | 309 | --- |
| beosub | 2011-01-20 at 13:51:30 | A trunk/Electrical/Altium/Projects/Power_Board_rev2/ | 253 | --- |
| mviswana | 2010-12-08 at 16:11:01 | M trunk/saliency/src/Robots/LoBot/control/LoOpenPath.C | 14306 | --- |
 | lzc | 2010-11-23 at 21:20:40 | A trunk/lzc/papers/TIP_targetDetection/doc/Saliency and Gist Features for Target Detection in Satellite Images_revise_R2.doc | 2236 | --- |
| sharat | 2010-08-25 at 09:09:48 | M trunk/saliency/src/Neuro/SimulationViewerEyeRegion.C | 13823 | --- |
 | josh | 2010-08-16 at 14:32:11 | M trunk/saliency/src/Robots/BeoHawk/computer/HawkSlammer.C | 13794 | Tue Jun 16 22:58:23 2009 |
| sychic | 2010-03-30 at 14:27:01 | M trunk/saliency/src/AppPsycho/psycho-test-timing.C | 13098 | --- |
| archit | 2010-01-11 at 16:56:12 | A trunk/saliency/src/CUDA/CudaHmaxFLSal.C | 12536 | --- |
| jmcinerney6 | 2010-01-07 at 18:20:27 | M trunk/saliency/src/CUDASIFT/cudasift-server.C | 12510 | Fri Nov 13 20:53:57 2009 |
| elno | 2009-12-28 at 20:15:22 | M trunk/saliency/src/AppPsycho/psycho-foe.C | 12425 | Sun Apr 12 00:22:31 2009 |
| tinachou | 2009-11-09 at 17:22:45 | M trunk/saliency/src/Robots/IRobot/test-IRobotSaliency.C | 11957 | --- |
| icore | 2009-10-22 at 09:01:03 | M trunk/saliency/src/Script/invt.C | 11877 | --- |
 | mundhenk | 2009-06-07 at 21:21:26 | M trunk/saliency/matlab/linear-classifier/matlab/linear_model_build_process_RSVP.m | 12503 | Mon Jun 15 16:34:32 2009 |
 | ibeo | 2009-05-21 at 09:40:18 | M trunk/saliency/tests/benchmark.txt | 12414 | --- |
| Dberg | 2009-05-19 at 14:14:07 | D trunk/dberg/papers/Human_Monkey/abstract.tex | 665 | --- |
 | bruce | 2009-03-18 at 12:30:45 | M trunk/saliency/src/Matlab/Simulink/CT2WS/test3channel_c.mdl | 12174 | --- |
| dhuber | 2009-01-30 at 11:34:52 | M trunk/CT2WS/CT2WSGUI.C | 201 | --- |
 | ilab24 | 2009-01-08 at 16:25:12 | M trunk/saliency/src/Media/FfmpegPacketDecoder.C | 11683 | --- |
 | bella | 2008-10-17 at 14:41:57 | M trunk/saliency/src/AppPsycho/psycho-still-audio.C | 11395 | --- |
| crystal | 2008-08-22 at 15:31:10 | M trunk/saliency/src/AppPsycho/psycho-spy2.C | 11137 | Tue Mar 9 17:16:12 2010 |
| moulard | 2008-07-22 at 16:44:34 | M trunk/saliency/src/Beobot/irobot-followColor.C | 10954 | --- |
 | rjpeters | 2008-05-12 at 10:11:21 | M trunk/saliency/src/NeovisionII/objRec-serverSift.C | 10738 | Mon May 5 13:22:24 2008 |
 | beo1 | 2008-02-08 at 14:22:46 | M trunk/saliency/src/Gist/train-texton.C | 10068 | --- |
| abondada | 2007-07-30 at 12:41:42 | M trunk/saliency/src/Audio/AudioWavFile.C | 9347 | --- |
| jbonaiuto | 2007-02-27 at 20:06:02 | D nsl_models/BasalGangliaModels/rddr/rddr.nsls | 892 | Fri Nov 5 16:52:17 2004 |
| harel | 2007-02-19 at 01:07:23 | M trunk/saliency/src/INVT/neovision2.C | 8351 | Thu Jun 26 06:22:40 2008 |
 | ilab13 | 2006-11-15 at 14:49:56 | A trunk/saliency/src/BeoSub/test-Skeleton.C | 7722 | --- |
 | imaster | 2006-08-24 at 19:53:36 | M trunk/saliency/src/AppMedia/app-parse-need-for-speed.C | 7295 | --- |
 | kopanathi | 2006-06-16 at 11:59:10 | A trunk/saliency/src/Psycho/Contgen.C | 7011 | --- |
 | ranc | 2006-04-04 at 14:12:24 | A trunk/SuperImposer/Makefile | 6653 | Sun May 28 02:57:55 2006 |
 | ilab15 | 2006-04-03 at 17:37:40 | M trunk/saliency/src/BeoSub/BeoSubOneBal.C | 6650 | --- |
 | vidhya | 2006-03-24 at 16:31:53 | A trunk/saliency/perl/README_Optimal_Biasing | 6616 | Sun Jan 12 11:43:12 2003 |
 | ilab12 | 2006-02-22 at 19:48:03 | M trunk/saliency/src/BeoSub/BeoSub.C | 6544 | --- |
 | ilab16 | 2005-10-13 at 01:19:19 | M trunk/saliency/Makefile.in | 5932 | --- |
| everist | 2005-08-22 at 11:42:29 | M trunk/saliency/src/IRoom/CoverageMap.C | 5585 | Wed May 24 17:23:49 2006 |
| zhanshi | 2005-07-15 at 17:00:17 | M trunk/saliency/src/Qt/GrabQtMainForm.ui | 5188 | Mon May 8 12:22:59 2006 |
 | beo2 | 2005-01-31 at 13:49:45 | M trunk/saliency/src3/psycho-obfba2.C | 4152 | --- |
 | walther | 2004-10-20 at 11:12:05 | A trunk/saliency/src3/mexDummy.C | 3870 | Mon Sep 17 21:16:05 2007 |
| bosa | 2004-09-13 at 15:04:26 | M trunk/saliency/src3/GAMPIvision.C | 3577 | Wed Apr 14 19:44:33 2004 |
 | beo3 | 2004-09-10 at 14:55:14 | M trunk/saliency/src3/BeoSub-defs.H | 3564 | --- |
| dhavale | 2004-07-14 at 20:32:09 | M trunk/saliency/src3/ContourChannel.C | 3421 | Fri Jul 16 13:02:42 2004 |
 | ilab | 2004-06-03 at 13:11:11 | A trunk/saliency/src3/ModelFace.H | 3337 | --- |
| pradeep | 2004-03-17 at 17:37:59 | M trunk/saliency/src3/CameraControl.C | 3159 | --- |
 | beo5 | 2003-07-15 at 23:46:08 | M trunk/saliency/src3/searcharray2.C | 2745 | --- |
 | daesu | 2003-05-13 at 14:40:09 | A trunk/saliency/src3/test-roadShape.C | 2588 | --- |
| hudson | 2003-04-22 at 15:08:57 | M trunk/saliency/src3/PbmParser.C | 2436 | Mon Sep 8 11:34:21 2003 |
 | rhirata | 2002-10-23 at 14:54:27 | M trunk/beobots/software/gyro/Gyro2.C | 1886 | --- |
| mehul | 2002-10-11 at 12:51:55 | M trunk/saliency/src3/Makefile | 1778 | --- |
| arun | 2002-10-04 at 00:30:04 | M trunk/saliency/src3/test-stereo.C | 1765 | --- |
 | chuck | 2002-08-23 at 18:44:01 | M trunk/saliency/src3/Makefile | 1718 | Fri Aug 23 16:42:15 2002 |
 | eric | 2001-12-19 at 19:15:00 | M trunk/saliency/src2/beobot-master.C | 657 | --- |
 | jsn | 2001-12-10 at 13:27:56 | M trunk/saliency/src2/BeobotEffectors.C | 529 | --- |
 | yooheesh | 2001-08-08 at 19:00:20 | A trunk/saliency/src2/test-psycho.C | 185 | --- |
| ramona | 2001-08-07 at 17:05:55 | M trunk/saliency/src2/vision.C | 183 | Tue Feb 21 13:49:37 2012 |
 | jinal | 2001-03-12 at 15:13:59 | M trunk/saliency/src/V4Lgrabber.C | 22 | --- |
 | aprilla | --- | Mon Jun 3 01:53:33 2002 | ||