Old Change Logs
Revision: 35b3f33e4e315fdd
Author: Davis King
Date: Feb 20, 2017 (15:45:36 UTC)

clarified spec

Modified
dlib/dnn/loss_abstract.h

Revision: 1b1e79fce55c15f9
Author: Davis King
Date: Feb 18, 2017 (18:23:16 UTC)

Made tests more robust and accurate

Modified
dlib/test/dnn.cpp

Revision: e097067e9abc21a1
Author: Davis King
Date: Feb 18, 2017 (14:48:58 UTC)

Changed cmake script to avoid warnings from visual studio.

Modified
dlib/CMakeLists.txt

Revision: 68afcc5bf7136fb2
Author: Davis King
Date: Feb 18, 2017 (14:20:59 UTC)

Fixed syntax error in cmake script.

Modified
dlib/CMakeLists.txt

Revision: fd58d09f23498b8d
Author: Davis King
Date: Feb 18, 2017 (10:33:09 UTC)

Don't build face recognition example if GUI support isn't enabled.

Modified
examples/CMakeLists.txt

Revision: 34c32a7967e36d51
Author: Davis King
Date: Feb 16, 2017 (02:35:43 UTC)

Fixed error in find_gap_between_convex_hulls() test

Modified
dlib/test/opt_qp_solver.cpp

Revision: 6b842e23f51904ea
Author: Davis King
Date: Feb 15, 2017 (16:31:33 UTC)

Added some comments about vector calculus.

Modified
dlib/dnn/loss.h

Revision: 11be214c3dc7736f
Author: Davis King
Date: Feb 15, 2017 (14:41:14 UTC)

merged

Modified
dlib/CMakeLists.txt

Revision: 6016a47dbe6d5b2d
Author: Kyle McDonald
Date: Feb 13, 2017 (08:03:37 UTC)

remove anaconda from X11_INCLUDE_DIR. closes #437 (#438)

Modified
dlib/CMakeLists.txt

Revision: 3796069f8aa8b5bb
Author: Davis King
Date: Feb 15, 2017 (12:06:03 UTC)

Added find_gap_between_convex_hulls()

Modified
dlib/optimization/optimization_solve_qp_using_smo.h
dlib/optimization/optimization_solve_qp_using_smo_abstract.h
dlib/test/opt_qp_solver.cpp

Revision: ead522d287a8510f
Author: Davis King
Date: Feb 12, 2017 (15:53:02 UTC)

cleanup

Modified
examples/dnn_face_recognition_ex.cpp

Revision: 860e151c61ac017c
Author: Davis King
Date: Feb 12, 2017 (15:51:50 UTC)

Fixed silly error in code.

Modified
dlib/image_processing/full_object_detection.h

Revision: 8aeefae78e1ecd5d
Author: Davis King
Date: Feb 12, 2017 (15:38:17 UTC)

Added a python version of the DNN face recognition example program.

Added
python_examples/face_recognition.py

Revision: 3709f82c1aac12a9
Author: Davis King
Date: Feb 12, 2017 (15:37:18 UTC)

Added a python interface to the face recognition DNN model.

Modified
tools/python/CMakeLists.txt
tools/python/src/dlib.cpp
Added
tools/python/src/face_recognition.cpp

Revision: 9d2a789665221e5f
Author: Davis King
Date: Feb 12, 2017 (11:47:49 UTC)

Make sure fPIC gets propagated to nvcc in all cases.

Modified
dlib/CMakeLists.txt
dlib/cmake_utils/add_python_module

Revision: e6d174d1eb01d2fd
Author: Davis King
Date: Feb 12, 2017 (11:03:40 UTC)

Made full_object_detection comparable via operator==

Modified
dlib/image_processing/full_object_detection.h
dlib/image_processing/full_object_detection_abstract.h

Revision: 77ba01f6b78eaeba
Author: Davis King
Date: Feb 12, 2017 (08:28:42 UTC)

Avoid crashing visual studio

Modified
examples/CMakeLists.txt

Revision: e00f763861885c02
Author: Davis King
Date: Feb 11, 2017 (12:07:51 UTC)

Disable another visual studio warning.

Modified
dlib/algs.h

Revision: 0225d8a21de6b546
Author: Davis King
Date: Feb 11, 2017 (11:45:22 UTC)

Added try/catch block to main

Modified
examples/dnn_face_recognition_ex.cpp

Revision: 79f97bbf6fdf9d50
Author: Davis King
Date: Feb 11, 2017 (10:36:24 UTC)

fixed grammar in comment

Modified
examples/dnn_face_recognition_ex.cpp

Revision: fc4e811c9def5e51
Author: Davis King
Date: Feb 11, 2017 (10:24:00 UTC)

clarified metric learning loss

Modified
dlib/dnn/loss_abstract.h

Revision: 820d899477e298c4
Author: Davis King
Date: Feb 11, 2017 (09:52:47 UTC)

Added face recognition example

Modified
examples/CMakeLists.txt
examples/dnn_metric_learning_on_images_ex.cpp
Added
examples/dnn_face_recognition_ex.cpp
examples/faces/bald_guys.jpg

Revision: 06845769b55af603
Author: Davis King
Date: Feb 11, 2017 (09:47:44 UTC)

Cleaned up loss_metric_ code a little

Modified
dlib/dnn/loss.h
dlib/dnn/loss_abstract.h

Revision: 3984c9a36e8f0429
Author: Davis King
Date: Feb 11, 2017 (07:06:46 UTC)

Added roc_point and compute_roc_curve().

Modified
dlib/statistics/lda.h
dlib/statistics/lda_abstract.h

Revision: b6b46aeecc8de4f5
Author: Davis King
Date: Feb 10, 2017 (15:35:46 UTC)

Fixed incorrect comment.

Modified
dlib/dnn/trainer.h

Revision: 86642a2d6d828ff1
Author: Davis King
Date: Feb 09, 2017 (07:38:39 UTC)

Minor cleanup

Modified
examples/dnn_metric_learning_on_images_ex.cpp

Revision: 14fda140fac5b6a7
Author: Davis King
Date: Feb 08, 2017 (17:53:55 UTC)

Made network smaller.

Modified
examples/dnn_metric_learning_on_images_ex.cpp

Revision: 8762abd86425a327
Author: Dennis Francis
Date: Feb 07, 2017 (08:52:39 UTC)

feature_addition : Mean squared loss layer for multiple output (#404) (#427) * feature_addition : Mean squared loss layer for multiple output (#404) * Added loss_mean_squared_multioutput layer to support multiple outputs. * Also added a corresponding test case to test a single variable regression with multiple outputs. * Added error checks on truth argument Added assert statements to check that truth argument in compute_loss_value_and_gradient() method contains matrices of correct dimension relative to the output tensor's size. Also the requirements on argument truth to the abstract documentation.

Modified
dlib/dnn/loss.h
dlib/dnn/loss_abstract.h
dlib/test/dnn.cpp

Revision: f56ee495ec1e1817
Author: David Miller
Date: Feb 01, 2017 (10:58:40 UTC)

GCC/Clang compatible SIMD code ./dlib/simd/simd**_vec.h (#414) * GCC/Clang compatible vector extension SIMD code * Minimal modifications to dlib for the simd_vec code to work, a few include changes and ifdefs * Changed tabbing to spaces * Allow type inference to binary ops on different types of same size * Added cmake option USE_AUTO_VECTOR, and fixed up preprocessor checks. It is required to build with gcc/clang auto vectorization * Changed to intrinsic version due to poor auto vectorization results. The simd8*_vec are just copies of the C code right now. * Removed _vec variants, added to existing defines. simd_check.h back in place and removed from dlib/simd.h

Modified
dlib/cmake
dlib/image_transforms/fhog.h
dlib/simd/simd4f.h
dlib/simd/simd4i.h
dlib/simd/simd8f.h
dlib/simd/simd_check.h

Revision: 4952b019167b9caa
Author: Davis King
Date: Jan 30, 2017 (10:18:39 UTC)

Made alias_tensor usable when it is const.

Modified
dlib/dnn/tensor.h
dlib/dnn/tensor_abstract.h

Revision: 73d5520ae19998ab
Author: Davis King
Date: Jan 30, 2017 (06:03:31 UTC)

Made dlib::thread_pool use std::thread and join on the threads in thread_pool's destructor. The previous implementation used dlib's global thread pooling to allocate threads to dlib::thread_pool, however, this sometimes caused annoying behavior when used as part of a MATLAB mex file.

Modified
dlib/threads/thread_pool_extension.cpp
dlib/threads/thread_pool_extension.h

Revision: e02b23ca0750aa25
Author: Davis King
Date: Jan 30, 2017 (05:56:47 UTC)

Made global thread pool shutdown not attempted unless the thread pool was already enabled. This also makes the global destruction order a little more deterministic.

Modified
dlib/threads/threads_kernel_shared.cpp

Revision: 9ed49aea6d41b247
Author: Davis King
Date: Jan 30, 2017 (04:56:06 UTC)

Made matrix literal assignment faster for column major matrices.

Modified
dlib/matrix/matrix.h

Revision: fca139c1d34b3c6e
Author: Davis King
Date: Jan 25, 2017 (01:59:08 UTC)

Fixed documentation

Modified
tools/python/src/shape_predictor.cpp

Revision: 56720f3015d727b2
Author: Daniel Crispell
Date: Jan 24, 2017 (14:11:30 UTC)

add support for loading of RGBA JPEG images (#409)

Modified
dlib/image_loader/jpeg_loader.cpp
dlib/image_loader/jpeg_loader.h

Revision: 27e0fc69d919bf54
Author: Davis King
Date: Jan 22, 2017 (06:32:27 UTC)

merged

Modified
examples/dnn_introduction2_ex.cpp
tools/imglab/README.txt

Revision: 7aa428cdfb3edb2d
Author: RangerUFO
Date: Jan 22, 2017 (31:36:40 UTC)

Fix comments typo in dnn_introduction2_ex (#405)

Modified
examples/dnn_introduction2_ex.cpp

Revision: c17082f59fe25809
Author: Frank
Date: Jan 16, 2017 (06:47:06 UTC)

Fix imglab readme typo in cd path (#400)

Modified
tools/imglab/README.txt

Revision: 13935a74049b696b
Author: Davis King
Date: Jan 21, 2017 (16:26:15 UTC)

Always compile dnn code.

Modified
dlib/CMakeLists.txt

Revision: 92594614f3de742b
Author: Davis King
Date: Jan 22, 2017 (05:25:29 UTC)

Added comments about test_one_step()

Modified
examples/dnn_introduction2_ex.cpp

Revision: df6d88905db8d270
Author: Davis King
Date: Jan 22, 2017 (05:25:06 UTC)

Added test_one_step() to the dnn_trainer. This allows you to do automatic early stopping based on observing the loss on held out data.

Modified
dlib/dnn/trainer.h
dlib/dnn/trainer_abstract.h

Revision: c80e888bdac79aa4
Author: Stefan Schweter
Date: Jan 08, 2017 (21:46:35 UTC)

Made matrix2 test more robust on ARM64 (#394)

Modified
dlib/test/matrix2.cpp

Revision: 7be4ff22448d3a93
Author: Davis King
Date: Jan 06, 2017 (11:12:54 UTC)

Only turn off CUDA_PROPAGATE_HOST_FLAGS on OS X since that's the only place that really needs it off.

Modified
dlib/CMakeLists.txt

Revision: 8cba3cbdd468dbc8
Author: Davis King
Date: Jan 09, 2017 (02:14:20 UTC)

Made sure cmake config file pulls in dependent include folders.

Modified
dlib/cmake_utils/dlibConfig.cmake.in

Revision: 450b23e56c3a9f10
Author: ernestotapiar
Date: Jan 06, 2017 (04:04:41 UTC)

cmake script to suppress randlib warnings about *.a having no symbols on MacOSX (#390) * cmake script to suppress randlib warnings about *.a having no symbols on MacOSX * Moved script code into the main CMakeLists.txt file to suppress the superfluous ranlib warnings all the time.

Modified
dlib/CMakeLists.txt

Revision: b28ea90fa729da6c
Author: Davis King
Date: Jan 04, 2017 (12:19:31 UTC)

Changed to avoid linker errors on some compilers.

Modified
dlib/pixel.h

Revision: f88e2a0430a03561
Author: Davis King
Date: Jan 04, 2017 (04:10:13 UTC)

Fixed cmake script so that nvcc gets the correct compiler options sent to it (in particular on mac os x, where this flag needs to be set this way for it to work in some cases).

Modified
dlib/CMakeLists.txt

Revision: 17c7c2219342a49a
Author: Davis King
Date: Jan 03, 2017 (01:35:32 UTC)

Initialized exception_ptr since some systems, incorrectly, don't initialize it automatically.

Modified
dlib/dnn/trainer.h

Revision: 253dfed88be54577
Author: rquk
Date: Jan 02, 2017 (18:08:03 UTC)

Fixed issue with uninitialised variables in thread_pool_extension. (#386) * Fixed issue with uninitialised variables. There are 2 places where std::exception_ptr eptr is not initialised. * running_gradient.h needs to qualify erfc with 'std::' to avoid compilation error. Found when compiling dnn_mmod_face_detection_ex.cpp with RadStudio and Clang compiler.

Modified
dlib/statistics/running_gradient.h
dlib/threads/thread_pool_extension.cpp
dlib/threads/thread_pool_extension.h

Revision: ff61b258c75b289c
Author: Davis King
Date: Dec 27, 2016 (04:33:41 UTC)

Made pixel_traits use constexpr everywhere to avoid compiler errors in newer compilers.

Modified
dlib/gui_core/gui_core_kernel_1.h
dlib/gui_core/gui_core_kernel_2.h
dlib/pixel.h

Revision: a340e4781e58c6e1
Author: Stefan Schweter
Date: Dec 24, 2016 (03:09:12 UTC)

Added new test case for split method (unicode non-breaking space) (#374)

Modified
dlib/test/string.cpp

Revision: 2e7eb3789277ac0a
Author: Davis King
Date: Dec 26, 2016 (03:56:40 UTC)

Made the dlib shared library build dependent on the static library build. This is because some build systems seem to mess up the parallel build of these two things and sometimes rebuild and potentially clobber object files during the parallel build. I haven't seen this result in a problem, but the race condition does seem to exist in some build systems. So this should force the two top level targets to be build sequentially rather than in parallel, thus avoiding any possible race condition.

Modified
dlib/CMakeLists.txt

Revision: 457530e2888669e8
Author: Davis King
Date: Dec 23, 2016 (05:12:12 UTC)

Added matlab_object to the mex wrapper. Now you can have parameters that are arbitrary matlab objects.

Modified
dlib/matlab/call_matlab.h
dlib/matlab/example_mex_function.cpp
dlib/matlab/mex_wrapper.cpp

Revision: a0f414b612966b53
Author: Davis King
Date: Dec 25, 2016 (07:32:48 UTC)

fixed spelling error in comment

Modified
dlib/dnn/trainer.h

Revision: 1ea53fefe15fbd03
Author: Davis King
Date: Dec 22, 2016 (15:43:50 UTC)

Removed C++11 check here since it's now redundant with the checks in algs.h. Also, the check doesn't work correctly in visual studio since visual studio doesn't define __cplusplus to 201103 even though the current version ostensibly supports C++11.

Modified
dlib/all/source.cpp

Revision: f003087ebdd79225
Author: Juha Reunanen
Date: Dec 20, 2016 (15:35:13 UTC)

Minor documentation fixes (#368)

Modified
dlib/image_transforms/random_cropper_abstract.h

Revision: 917332ad117dac01
Author: Davis E. King
Date: Dec 19, 2016 (10:14:49 UTC)

Merge pull request #365 from reunanen/fix-363 Fix #363 by not setting CUDA_HOST_COMPILER when targeting Visual Studio

Modified
dlib/CMakeLists.txt

Revision: cc6fec145c693d78
Author: Juha Reunanen
Date: Dec 19, 2016 (21:02:27 UTC)

Set CUDA_HOST_COMPILER when not targeting Visual Studio

Modified
dlib/CMakeLists.txt

Revision: fdf84afc2cc22701
Author: Juha Reunanen
Date: Dec 19, 2016 (18:10:38 UTC)

Workaround for #363: do not set CUDA_HOST_COMPILER for the CUDA test

Modified
dlib/CMakeLists.txt

Revision: fe39427ad616dd3a
Author: Juha Reunanen
Date: Dec 19, 2016 (19:07:43 UTC)

Problem: Visual Studio linker errors resulting from mixed /MT and /MD settings Solution: don't set CUDA_PROPAGATE_HOST_FLAGS to OFF when using Visual Studio

Modified
dlib/CMakeLists.txt

Revision: 5821cafa67ecc8f6
Author: Davis King
Date: Dec 18, 2016 (18:35:25 UTC)

Changed build order to see if it prevents travis from crashing.

Modified
examples/CMakeLists.txt

Revision: 0d9340beee693521
Author: Davis King
Date: Dec 18, 2016 (15:52:45 UTC)

Minor improvement to example

Modified
examples/dnn_metric_learning_on_images_ex.cpp

Revision: 2088fe75c0c744af
Author: Davis King
Date: Dec 18, 2016 (08:20:37 UTC)

more cleanup

Modified
examples/dnn_metric_learning_on_images_ex.cpp

Revision: 1c3bc4eec6e9e184
Author: Davis King
Date: Dec 18, 2016 (08:10:13 UTC)

Improved example

Modified
examples/dnn_metric_learning_on_images_ex.cpp

Revision: 7e33779c306dec13
Author: Davis King
Date: Dec 17, 2016 (15:41:36 UTC)

Finished the more complex metric learning example and added some example data.

Modified
examples/dnn_metric_learning_on_images_ex.cpp
Added
examples/johns/John_Salley/000179_02159509.jpg
examples/johns/John_Salley/000183_02159543.jpg
examples/johns/John_Salley/000186_02159346.jpg
examples/johns/John_Salley/000189_02159361.jpg
examples/johns/John_Salley/000190_02159501.jpg
examples/johns/John_Salley/000192_02159531.jpg
examples/johns/John_Salley/000194_02159572.jpg
examples/johns/John_Salley/000197_02159322.jpg
examples/johns/John_Salley/000197_02159525.jpg
examples/johns/John_Salley/000198_02159470.jpg
examples/johns/John_Salley/000200_02159354.jpg
examples/johns/John_Savage/000264_01099001.jpg
examples/johns/John_Savage/000274_01099061.jpg
examples/johns/John_Savage/000277_01099000.jpg
examples/johns/John_Savage/000289_01099139.jpg
examples/johns/John_Savage/000290_01099067.jpg
examples/johns/John_Savage/000290_01099090.jpg
examples/johns/John_Savage/000291_01099023.jpg
examples/johns/John_Savage/000291_01099214.jpg
examples/johns/John_Savage/000293_01099081.jpg
examples/johns/John_Savage/000296_01099007.jpg
examples/johns/John_Savage/000299_01099008.jpg
examples/johns/John_Schneider/000288_00925786.jpg
examples/johns/John_Schneider/000302_00925785.jpg
examples/johns/John_Schneider/000307_00925823.jpg
examples/johns/John_Schneider/000325_00925954.jpg
examples/johns/John_Schneider/000326_00925765.jpg
examples/johns/John_Schneider/000326_00926089.jpg
examples/johns/John_Schneider/000326_00926128.jpg
examples/johns/John_Schneider/000326_00926139.jpg
examples/johns/John_Schneider/000329_00925859.jpg
examples/johns/John_Schneider/000329_00925963.jpg
examples/johns/John_Schneider/000331_00926012.jpg
examples/johns/John_Shimkus/000373_03228153.jpg
examples/johns/John_Shimkus/000375_03227651.jpg
examples/johns/John_Shimkus/000376_02340068.jpg
examples/johns/John_Shimkus/000378_02340151.jpg
examples/johns/John_Shimkus/000378_03227610.jpg
examples/johns/John_Shimkus/000383_03227939.jpg
examples/johns/John_Shimkus/000385_03227766.jpg
examples/johns/John_Shimkus/000388_03227773.jpg
examples/johns/John_Shimkus/000390_03227666.jpg
examples/johns/John_Shimkus/000394_02340150.jpg
examples/johns/John_Shimkus/000396_03227722.jpg
examples/johns/John_Simm/000288_00470387.jpg
examples/johns/John_Simm/000297_00470170.jpg
examples/johns/John_Simm/000300_00470148.jpg
examples/johns/John_Simm/000304_00470122.jpg
examples/johns/John_Simm/000305_00470162.jpg
examples/johns/John_Simm/000305_00470717.jpg
examples/johns/John_Simm/000306_00470222.jpg
examples/johns/John_Simm/000306_00470223.jpg
examples/johns/John_Simm/000309_00470287.jpg
examples/johns/John_Simm/000310_00470421.jpg
examples/johns/John_Simm/000310_00470511.jpg

Revision: 70cd167f83ef7711
Author: Davis King
Date: Dec 17, 2016 (11:46:39 UTC)

Improved example

Modified
examples/dnn_metric_learning_ex.cpp

Revision: 3254c571384e1834
Author: Davis King
Date: Dec 17, 2016 (11:11:18 UTC)

Cleaned up example

Modified
examples/dnn_metric_learning_ex.cpp

Revision: 96e3596b9d8c79a0
Author: Davis King
Date: Dec 17, 2016 (10:08:58 UTC)

fixed grammar

Modified
dlib/dnn/loss_abstract.h

Revision: b2164124cf92daa0
Author: Davis King
Date: Dec 17, 2016 (09:29:29 UTC)

Added another metric learning example

Modified
examples/CMakeLists.txt
examples/dnn_metric_learning_ex.cpp
Added
examples/dnn_metric_learning_on_images_ex.cpp

Revision: 6986f126dc8e8e6d
Author: Davis King
Date: Dec 17, 2016 (08:37:01 UTC)

Made get_net() sync to disk if the disk date is out of date. This way, when using train_one_step(), you will get the behavior of automatic disk syncs at the end of training.

Modified
dlib/dnn/trainer.h
dlib/dnn/trainer_abstract.h

Revision: 5d5249551797d05f
Author: Davis King
Date: Dec 17, 2016 (05:56:27 UTC)

Added metric learning example

Modified
examples/CMakeLists.txt
Added
examples/dnn_metric_learning_ex.cpp

Revision: bfe738d443233a60
Author: Davis King
Date: Dec 17, 2016 (05:45:55 UTC)

clarified spec

Modified
dlib/dnn/trainer_abstract.h

Revision: 0559cc5e7bbda8e3
Author: Davis King
Date: Dec 17, 2016 (05:30:46 UTC)

Added docs and cleaned up code slightly.

Modified
dlib/dnn/loss.h
dlib/dnn/loss_abstract.h

Revision: ee835f2b30370b1f
Author: Davis King
Date: Dec 17, 2016 (04:45:03 UTC)

Removed loss_metric_hardish_

Modified
dlib/dnn/loss.h

Revision: 25c22f567aebab2e
Author: Davis King
Date: Dec 15, 2016 (11:06:37 UTC)

Allow enqueueing to a pipe from rvalues.

Modified
dlib/pipe/pipe_kernel_1.h
dlib/pipe/pipe_kernel_abstract.h

Revision: d6a6124156e4293b
Author: Davis King
Date: Dec 15, 2016 (04:07:04 UTC)

Fixed incorrect mex file name being shown in the generated class code.

Modified
dlib/matlab/CMakeLists.txt
dlib/matlab/cmake_mex_wrapper
dlib/matlab/mex_wrapper.cpp

Revision: f2d66cf532a73125
Author: Davis King
Date: Dec 14, 2016 (10:09:53 UTC)

Improved how cmake sets up clang and cuda. This is basically to work around partial C++11 support and funny cmake behavior of clang on OS X.

Modified
dlib/CMakeLists.txt
dlib/cmake_utils/use_cpp_11.cmake

Revision: 7c9b777fbd84469a
Author: Davis King
Date: Dec 14, 2016 (10:08:45 UTC)

Made this test try to enable C++11 via the compiler flag.

Modified
dlib/cmake_utils/test_for_cpp11/CMakeLists.txt

Revision: 3ad63d456a997bb5
Author: Davis King
Date: Dec 14, 2016 (04:51:03 UTC)

Updated C++11 enabling script to work around some kind of bug in cmake related to new versions of clang on OSX, without this extra statement C++11 wasn't being enabled.

Modified
dlib/cmake_utils/use_cpp_11.cmake

Revision: e91efa76ed9645ba
Author: Davis King
Date: Dec 13, 2016 (04:57:07 UTC)

Suppressed cmake warning

Modified
dlib/CMakeLists.txt

Revision: e6021de44315bd86
Author: Davis King
Date: Dec 13, 2016 (04:36:55 UTC)

Set set(CMAKE_CXX_STANDARD_REQUIRED YES)

Modified
dlib/cmake_utils/use_cpp_11.cmake

Revision: f975dd4cc28ce392
Author: Davis King
Date: Dec 10, 2016 (06:20:20 UTC)

Relaxed requires clauses even more.

Modified
dlib/image_transforms/random_cropper.h
dlib/image_transforms/random_cropper_abstract.h

Revision: 8e794a4fd291d677
Author: Davis King
Date: Dec 10, 2016 (06:03:07 UTC)

Relaxed require clause

Modified
dlib/image_transforms/random_cropper.h
dlib/image_transforms/random_cropper_abstract.h

Revision: 51c6afcaa41c826d
Author: Davis King
Date: Dec 10, 2016 (03:36:45 UTC)

Added an overload of flip_image_left_right() that operates inplace.

Modified
dlib/image_transforms/interpolation.h
dlib/image_transforms/interpolation_abstract.h

Revision: e47f00a5291e31ee
Author: Davis King
Date: Dec 09, 2016 (16:05:18 UTC)

Relaxed requires clause slightly

Modified
dlib/image_transforms/random_cropper.h
dlib/image_transforms/random_cropper_abstract.h

Revision: b71b824c942b4de2
Author: Davis King
Date: Dec 09, 2016 (14:51:58 UTC)

Made dlib::array movable.

Modified
dlib/array/array_kernel.h
dlib/array/array_kernel_abstract.h

Revision: 13b679aea0be116b
Author: Davis King
Date: Nov 30, 2016 (05:36:32 UTC)

Fixed missing implementation of map_input_to_output() and map_output_to_input() in the concat_ layer.

Modified
dlib/dnn/layers.h

Revision: 7506978fb45dc29a
Author: Davis King
Date: Nov 29, 2016 (06:05:16 UTC)

Added running_stats_decayed

Modified
dlib/statistics/statistics.h
dlib/statistics/statistics_abstract.h

Revision: 0c40eff84c399624
Author: Davis King
Date: Nov 28, 2016 (15:03:17 UTC)

Made dlib/cmake add the appropriate folders to client include search paths.

Modified
dlib/CMakeLists.txt
dlib/cmake

Revision: 475a03e598fb12a3
Author: Duncan Palmer
Date: Nov 28, 2016 (26:07:14 UTC)

Ensure MKL detection doesn't depend on MKL header files being present. Apparently, MKL installations don't always include header files. So detect MKL libraries and headers seperately.

Modified
dlib/CMakeLists.txt
dlib/cmake_utils/cmake_find_blas.txt

Revision: f52ad8692907a4b6
Author: Duncan Palmer
Date: Nov 23, 2016 (14:05:13 UTC)

Seperate MKL FFT and MKL BLAS configurations. MKL FFT bindings had assumed that MKL was also being used to provide the BLAS implementation, however the build system allows these 2 things to be configured independantly.

Modified
dlib/CMakeLists.txt
dlib/cmake_utils/cmake_find_blas.txt

Revision: 685838d8af7b5b94
Author: Duncan Palmer
Date: Sep 08, 2016 (24:41:52 UTC)

Add MKL DFTI FFT bindings.

Modified
dlib/CMakeLists.txt
dlib/cmake_utils/cmake_find_blas.txt
dlib/config.h.in
dlib/matrix/matrix_fft.h

Revision: a9593a0555281389
Author: Davis King
Date: Nov 27, 2016 (08:24:16 UTC)

clarified spec

Modified
dlib/clustering/bottom_up_cluster_abstract.h

Revision: 555f7f98a3321165
Author: Davis King
Date: Nov 27, 2016 (08:20:10 UTC)

Added segment_number_line().

Modified
dlib/clustering/bottom_up_cluster.h
dlib/clustering/bottom_up_cluster_abstract.h
dlib/test/clustering.cpp

Revision: 84dfcad68385e915
Author: Davis King
Date: Nov 26, 2016 (10:48:00 UTC)

Added append() to random_cropper.

Modified
dlib/image_transforms/random_cropper.h
dlib/image_transforms/random_cropper_abstract.h

Revision: 9510bb9314401fa6
Author: Davis King
Date: Nov 26, 2016 (03:26:59 UTC)

Made the random translation amount user settable.

Modified
dlib/image_transforms/random_cropper.h
dlib/image_transforms/random_cropper_abstract.h

Revision: b0644464754f58e6
Author: Davis King
Date: Nov 26, 2016 (03:17:24 UTC)

Changed to avoid gcc warnings

Modified
dlib/dnn/input.h

Revision: 6f7b3c6bf20a20b0
Author: Dennis Francis
Date: Nov 26, 2016 (14:37:36 UTC)

adapt to dlib indentation style

Modified
dlib/dnn/loss.h
dlib/dnn/loss_abstract.h
dlib/test/dnn.cpp

Revision: 6522d8c5785742a5
Author: Dennis Francis
Date: Nov 25, 2016 (27:45:39 UTC)

converted tabs to spaces in the indentation

Modified
dlib/dnn/loss.h
dlib/test/dnn.cpp

Revision: a460abd4fd4d0d9f
Author: Dennis Francis
Date: Nov 23, 2016 (19:74:33 UTC)

feature_addition : Added a mean squared loss layer to DNN Added mean squared loss layer "loss_mean_squared" to DNN as requested in https://github.com/davisking/dlib/issues/152 Also added test case of a simple linear regression with one variable that uses this layer.

Modified
dlib/dnn/loss.h
dlib/dnn/loss_abstract.h
dlib/test/dnn.cpp

Revision: 7e3cf5042c2a9ead
Author: Stefan Schweter
Date: Nov 19, 2016 (18:54:56 UTC)

Disable misleading-indentation warning in unicode.h (pragma for GCC >= 6)

Modified
dlib/unicode/unicode.h

Revision: d17ddfe34f8e7177
Author: Davis King
Date: Nov 25, 2016 (02:46:52 UTC)

Clarified spec

Modified
dlib/image_transforms/random_cropper_abstract.h

Revision: cc5d9caedb5c1105
Author: Davis King
Date: Nov 22, 2016 (07:59:24 UTC)

Fixed compile time error in random_subset_selector::swap()

Modified
dlib/statistics/random_subset_selector.h

Revision: 1a86b32362308860
Author: Davis King
Date: Nov 18, 2016 (08:47:50 UTC)

Made tt::add() more general

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cuda_dlib.cu
dlib/dnn/cuda_dlib.h
dlib/dnn/cudnn_dlibapi.cpp
dlib/dnn/tensor_tools.h
dlib/test/dnn.cpp

Revision: 4e9fa80c14f028cd
Author: Davis King
Date: Nov 18, 2016 (07:40:01 UTC)

Suppress bogus warnings from nvcc about unreachable code that is actually reachable.

Modified
dlib/algs.h

Revision: 9a400902da27a32c
Author: Davis King
Date: Nov 18, 2016 (05:42:03 UTC)

Added min_pointwise() and max_pointwise().

Modified
dlib/matrix/matrix_utilities.h
dlib/matrix/matrix_utilities_abstract.h
dlib/test/matrix.cpp

Revision: 0f33099b2f19a5ce
Author: Davis King
Date: Nov 17, 2016 (07:10:54 UTC)

Made non-const alias tensors convertible to const alias tensors.

Modified
dlib/dnn/tensor.h
dlib/dnn/tensor_abstract.h

Revision: 29c4d3ea7bd70110
Author: Davis King
Date: Nov 19, 2016 (10:37:51 UTC)

Made the dnn_trainer's detection and backtracking from situations with increasing loss more robust. Now it will never get into a situation where it backtracks over and over. Instead, it will only backtrack a few times in a row before just letting SGD run unimpeded.

Modified
dlib/dnn/trainer.h

Revision: 358dc20ad776fd4a
Author: Davis King
Date: Nov 15, 2016 (01:56:00 UTC)

Added missing #include

Modified
dlib/image_processing/correlation_tracker.h

Revision: c9a9b5c662feb7e0
Author: caseymcc
Date: Nov 14, 2016 (07:52:45 UTC)

Remove initializer lists support for Apple/Clang (libstdc++ version used does not include std::initializer_list)

Modified
dlib/assert.h

Revision: df3a4de43efb9f0c
Author: Davis King
Date: Nov 14, 2016 (10:47:04 UTC)

Avoid division by zero in running_scalar_covariance_decayed.

Modified
dlib/statistics/statistics.h

Revision: 403deb128098f6ae
Author: Davis King
Date: Nov 14, 2016 (06:06:56 UTC)

Added running_scalar_covariance_decayd

Modified
dlib/statistics/statistics.h
dlib/statistics/statistics_abstract.h
dlib/test/statistics.cpp

Revision: de112e9f01f1b126
Author: Avi Haiat
Date: Nov 12, 2016 (16:54:48 UTC)

Expose python binding for running multiple detectors at once (#328) * Expose python binding for running multiple detectors at once * Remove unwanted typedef

Modified
tools/python/src/object_detection.cpp
tools/python/src/simple_object_detector_py.h

Revision: ae4e3984e1d04ccc
Author: MambaWong
Date: Nov 12, 2016 (19:39:05 UTC)

Modify to support both train-images-idx3-ubyte and train-images.idx3-ubyte styles of the filename. (#327)

Modified
dlib/data_io/mnist.cpp

Revision: dbc4a0c8365e10ce
Author: Avi Haiat
Date: Nov 10, 2016 (05:36:52 UTC)

Add option --rm-other-labels to imglab (#323) * Add option --rm-other-labels to imglab * Add support for comma separated list of labels

Modified
tools/imglab/src/main.cpp

Revision: 44c0e160fac405c1
Author: Davis King
Date: Nov 09, 2016 (05:30:16 UTC)

Fixed rls numerical instability.

Modified
dlib/svm/rls.h

Revision: 68b8859404b273dd
Author: Davis King
Date: Nov 08, 2016 (09:40:19 UTC)

Made rls run a bit faster, especially if the new mode that allows the regularization to decay away is activated.

Modified
dlib/svm/rls.h
dlib/svm/rls_abstract.h

Revision: 151810f94cabb586
Author: Davis King
Date: Nov 08, 2016 (06:03:40 UTC)

Fixed matlab crashing when an error message from a mex file included the % character, since that is interpreted by matlab as part of an eventual printf() code.

Modified
dlib/matlab/mex_wrapper.cpp

Revision: 69ac1166bbd80f50
Author: Davis King
Date: Nov 07, 2016 (14:50:12 UTC)

Make sure the state of the assert macros is always consistent between how dlib is built as a stand alone library and what appears in the config.h file.

Modified
dlib/CMakeLists.txt

Revision: 54d0970d0a953330
Author: Davis King
Date: Nov 06, 2016 (08:53:22 UTC)

Adding more possible metric loss layers.

Modified
dlib/dnn/loss.h

Revision: 37b2375391469e62
Author: Davis King
Date: Nov 05, 2016 (17:12:33 UTC)

Changed the loss layer interface to use two typedefs, output_label_type and training_label_type instead of a single label_type. This way, the label type used for training can be distinct from the type output by the network. This change breaks backwards compatibility with the previous API.

Modified
dlib/dnn/core.h
dlib/dnn/core_abstract.h
dlib/dnn/loss.h
dlib/dnn/loss_abstract.h
dlib/dnn/trainer.h
dlib/dnn/trainer_abstract.h

Revision: aa3bbd123ccdcb09
Author: Davis King
Date: Nov 05, 2016 (06:52:09 UTC)

Added serialization support for std::array.

Modified
dlib/serialize.h
dlib/test/serialize.cpp

Revision: d7710f6301efea99
Author: Davis King
Date: Nov 04, 2016 (16:30:03 UTC)

Changed CMake so it doesn't automatically enable asserts in debug builds since this frustrates Visual Studio users who want to compile dlib as a static library.

Modified
dlib/CMakeLists.txt

Revision: b212277ed1a04acd
Author: Stefan Schweter
Date: Nov 04, 2016 (22:55:25 UTC)

Explicitly use signed char in max_cost_assignment test (fix for ARM/ARM64) (#316)

Modified
dlib/test/max_cost_assignment.cpp

Revision: ed8309665c022d71
Author: Stefan Schweter
Date: Nov 04, 2016 (19:48:09 UTC)

Made active_learning test more robust on ARM64. (#315)

Modified
dlib/test/active_learning.cpp

Revision: 9e3cb4d950630b72
Author: caseymcc
Date: Oct 28, 2016 (09:15:55 UTC)

fix include issue when using libjpeg compiled outside of dlib (#307)

Modified
dlib/image_saver/save_jpeg.cpp

Revision: da705c1bfa258481
Author: Davis King
Date: Nov 02, 2016 (06:12:07 UTC)

Fixed compile time error.

Modified
dlib/dnn/tensor.h

Revision: 0f44bd64a3b6da0e
Author: Davis King
Date: Nov 02, 2016 (06:06:36 UTC)

Wrote replacements for set_tensor() and scale_tensor() since the previous versions were calling into cuDNN, however, the cuDNN functions for doing this are horrifically slow, well over 100x slower than they should be, which is surprising since these functions are so trivial.

Modified
dlib/dnn/cuda_dlib.cu
dlib/dnn/cuda_dlib.h
dlib/dnn/cudnn_dlibapi.cpp
dlib/dnn/cudnn_dlibapi.h
dlib/dnn/tensor.h
dlib/test/dnn.cpp

Revision: 40de2fbd2bfbf0a2
Author: Davis King
Date: Oct 30, 2016 (03:42:27 UTC)

Made test deterministic

Modified
dlib/test/discriminant_pca.cpp

Revision: 6fd6fcb3ae8f4383
Author: Davis King
Date: Oct 27, 2016 (07:29:27 UTC)

Fixed some race conditions in cuda code.

Modified
dlib/dnn/cuda_dlib.cu

Revision: 3fb9cb42908da65e
Author: Davis King
Date: Oct 26, 2016 (13:09:44 UTC)

Fixed compiler warnings

Modified
dlib/dnn/tensor.h

Revision: f6597d42842009ad
Author: Davis King
Date: Oct 26, 2016 (13:06:02 UTC)

Added tt::scale_columns(). Also optimized some other cuda kernel launches a little.

Modified
dlib/dnn/cuda_dlib.cu
dlib/dnn/cuda_dlib.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h

Revision: cf213dfacd1ebded
Author: Davis King
Date: Oct 26, 2016 (12:49:56 UTC)

Added is_vector() for tensor objects.

Modified
dlib/dnn/tensor.h
dlib/dnn/tensor_abstract.h

Revision: 7ecdc2e44d57a754
Author: Davis King
Date: Oct 26, 2016 (05:06:05 UTC)

Improved cudnn error messages.

Modified
dlib/dnn/cudnn_dlibapi.cpp

Revision: 5e6cf2433e49ba1d
Author: Davis King
Date: Oct 23, 2016 (11:13:46 UTC)

Added l2normalize_ layer.

Modified
dlib/dnn/cuda_dlib.cu
dlib/dnn/cuda_dlib.h
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h
dlib/test/dnn.cpp

Revision: 2076132a771b0907
Author: Davis King
Date: Oct 23, 2016 (06:44:05 UTC)

Made approximate derivative calculation slightly more numerically robust.

Modified
dlib/optimization/optimization.h

Revision: 36d2e4b214b33488
Author: Davis King
Date: Oct 21, 2016 (18:48:03 UTC)

Made the dnn_trainer automatically reload from the last good state if a loss of NaN is encountered.

Modified
dlib/dnn/trainer.h

Revision: eaf32ef301e22fcd
Author: Davis King
Date: Oct 18, 2016 (18:54:34 UTC)

Fixed a bug in the repeat layer that caused it to throw exceptions in some cases.

Modified
dlib/dnn/core.h

Revision: 3003fe9808305f60
Author: Davis King
Date: Oct 16, 2016 (15:51:19 UTC)

Added --rmignore

Modified
tools/imglab/src/main.cpp

Revision: 007a4fabe1cfd6ac
Author: Davis King
Date: Oct 16, 2016 (12:38:17 UTC)

Added loss_metric_

Modified
dlib/dnn/loss.h

Revision: 6ecb13bd4efdc2f4
Author: Davis King
Date: Oct 16, 2016 (12:21:28 UTC)

Improved xml logging for --resample

Modified
tools/imglab/src/main.cpp

Revision: 9dc1723d0ec278d0
Author: Davis King
Date: Oct 16, 2016 (12:19:24 UTC)

removed --extract-chips

Modified
tools/imglab/src/main.cpp

Revision: 969b13255a40430a
Author: Davis King
Date: Oct 16, 2016 (12:10:44 UTC)

Fixed confusing -h docs

Modified
tools/imglab/src/main.cpp

Revision: 91364e2f189cb037
Author: Davis King
Date: Oct 16, 2016 (12:09:06 UTC)

Added --jpg and --one-object-per-image.

Modified
tools/imglab/src/main.cpp

Revision: 3cb6c541e2a9e01d
Author: Evgeniy Fominov
Date: Oct 14, 2016 (24:44:31 UTC)

Travis CI Integration scripts (#294)

Added
.travis.yml
dlib/travis/before-install.sh
dlib/travis/build-and-test.sh

Revision: d8b1a27bf2732380
Author: hannometer
Date: Oct 14, 2016 (16:35:09 UTC)

pass CUDA_HOST_COMPILER variable to cuda cmake tests (#292)

Modified
dlib/CMakeLists.txt

Revision: b7900c78a0328bbc
Author: Mateusz Baran
Date: Oct 14, 2016 (14:54:59 UTC)

optimization - poly_min_extrap fixed for a specific case (#291) If temp is nonzero but a subnormal then temp2 matrix may contain infinities which may cause temp assignment in line 225 to be a NaN (as a difference of two positive infinities).

Modified
dlib/optimization/optimization_line_search.h

Revision: 0e231bb9d3f2da6a
Author: Davis King
Date: Oct 10, 2016 (15:36:19 UTC)

Record last changeset and set PATCH version to 99

Modified
dlib/CMakeLists.txt
docs/.logger_revnum

Revision: f8fa027c760270d8
Author: Davis King
Date: Oct 10, 2016 (15:34:32 UTC)

Created release v19.2

Modified
dlib/CMakeLists.txt

Revision: 9d2cc9605dabbc51
Author: Davis King
Date: Oct 10, 2016 (14:26:09 UTC)

Made tensor copies a little more efficient.

Modified
dlib/dnn/tensor.h

Revision: c6c9fdeaa6415cde
Author: Evgeniy Fominov
Date: Oct 10, 2016 (18:32:16 UTC)

Added threads.h into shape_predictor.h (#283)

Modified
dlib/image_processing/shape_predictor.h

Revision: a37ad2dbe73ebd80
Author: Evgeniy Fominov
Date: Oct 10, 2016 (18:30:22 UTC)

Fix for #281 (#282)

Modified
dlib/threads/async.cpp

Revision: 17e2aad4fd065e39
Author: Davis King
Date: Oct 10, 2016 (04:12:58 UTC)

Added missing #include.

Modified
dlib/threads/async.cpp

Revision: 3e63dfdda30dc7e3
Author: Davis King
Date: Oct 10, 2016 (03:36:10 UTC)

Added missing #include

Modified
dlib/image_processing/shape_predictor.h

Revision: 38e96e999d2cebb3
Author: Davis King
Date: Oct 09, 2016 (19:29:20 UTC)

Removing mltool since I'm pretty sure no one uses it and it might even cause user confusion.

Modified
dlib/test/tools/CMakeLists.txt
Deleted
tools/mltool/CMakeLists.txt
tools/mltool/src/common.h
tools/mltool/src/main.cpp
tools/mltool/src/option_range.cpp
tools/mltool/src/option_range.h
tools/mltool/src/regression.cpp
tools/mltool/src/regression.h

Revision: 0276c3e7b67d2eef
Author: Davis King
Date: Oct 09, 2016 (19:18:46 UTC)

Made unit tests compile stuff in tools folder

Modified
dlib/test/CMakeLists.txt
Added
dlib/test/tools/CMakeLists.txt

Revision: 96a3a68254e12408
Author: Davis King
Date: Oct 09, 2016 (19:18:12 UTC)

Minor code cleanup.

Modified
dlib/image_transforms/image_pyramid.h

Revision: be4f95c3025c0c8a
Author: Davis King
Date: Oct 09, 2016 (14:25:52 UTC)

Improved check for old visual studio

Modified
dlib/cmake_utils/use_cpp_11.cmake

Revision: f1e84240b9f944fd
Author: Davis King
Date: Oct 09, 2016 (14:19:51 UTC)

Fixed old visual studio check

Modified
dlib/cmake_utils/use_cpp_11.cmake

Revision: 3f65c6abd14c2ffa
Author: Davis King
Date: Oct 09, 2016 (14:13:21 UTC)

Improved error messages about non-C++11 compilers and made the example cmake file a little clearer on this issue.

Modified
dlib/cmake_utils/use_cpp_11.cmake
examples/CMakeLists.txt

Revision: 0cb043aab1a94228
Author: Davis King
Date: Oct 09, 2016 (12:36:48 UTC)

Renamed file so it matches the naming scheme of the other matlab examples.

Modified
dlib/matlab/CMakeLists.txt
Added
dlib/matlab/example_mex_class.cpp
Deleted
dlib/matlab/mex_example_class.cpp

Revision: 0a5f86061b25eeb4
Author: Davis King
Date: Oct 09, 2016 (06:38:03 UTC)

Moved all the test_object_detection_function() specs into one file so they are organized in the HTML documentation.

Modified
dlib/dnn/validation.h
dlib/svm/cross_validate_object_detection_trainer_abstract.h
Deleted
dlib/dnn/validation_abstract.h

Revision: b87b1987c2fa72de
Author: Davis King
Date: Oct 08, 2016 (11:28:58 UTC)

Changed cmake so it compiles most of the DNN examples when using visual studio.

Modified
dlib/cmake_utils/use_cpp_11.cmake
examples/CMakeLists.txt

Revision: 5568c09ce2ef01e1
Author: Davis King
Date: Oct 08, 2016 (10:28:21 UTC)

Added warning message about trying to use cuda from a 32 bit visual studio project.

Modified
dlib/CMakeLists.txt

Revision: 09538bd6884d5d85
Author: Davis King
Date: Oct 08, 2016 (10:27:34 UTC)

Evgeniy Fominov's changes that avoid compiler bugs in Visual Studio.

Modified
examples/dnn_imagenet_ex.cpp
examples/dnn_imagenet_train_ex.cpp

Revision: 1dbb13122991d995
Author: Davis King
Date: Oct 08, 2016 (10:26:33 UTC)

Minor change to avoid warnings from visual studio.

Modified
dlib/image_transforms/image_pyramid.h

Revision: 1f0c4fd8dc47fb83
Author: Davis King
Date: Oct 07, 2016 (18:07:13 UTC)

Made the upsampling conditional on the image not being huge already.

Modified
examples/dnn_mmod_face_detection_ex.cpp

Revision: 2a834745327ca5c7
Author: elda27
Date: Oct 07, 2016 (28:36:58 UTC)

find_cudnn modified for cudnn installed a user directory. (#275)

Modified
dlib/cmake_utils/test_for_cudnn/find_cudnn.txt

Revision: 9251f7002f1f5525
Author: Jan Rüegg
Date: Oct 05, 2016 (19:15:31 UTC)

Unreachable code, fixed compiler warning (#272) * Unreachable code, fixed compiler warning * Update simd4f.h

Modified
dlib/simd/simd4f.h

Revision: fa8285990c12208b
Author: Jan Rüegg
Date: Oct 05, 2016 (18:57:01 UTC)

Unreachable code, fixed compiler warning (#271) * Unreachable code, fixed compiler warning * Update simd8f.h

Modified
dlib/simd/simd8f.h

Revision: 27148e269324a6a7
Author: Davis King
Date: Oct 05, 2016 (06:23:02 UTC)

Made the dnn_trainer check if the loss has been increasing before it saves the state to disk. If it detects that the loss has been going up then instead of saving to disk it recalls the previously good state. This way, if we hit a bad mini-batch during training which negatively effects the model in a significant way, the dnn_trainer will automatically revert back to an earlier good state.

Modified
dlib/dnn/trainer.h

Revision: 6ae4620f2ac43b69
Author: Davis King
Date: Oct 03, 2016 (15:55:31 UTC)

Made find_upper_quantile() more general

Modified
dlib/statistics/running_gradient.h
dlib/statistics/running_gradient_abstract.h

Revision: 4333eb792b01417e
Author: Davis King
Date: Oct 02, 2016 (13:52:39 UTC)

Merge branch 'skip_gui_examples' of git://github.com/miscellanea/dlib into miscellanea-skip_gui_examples Conflicts: examples/CMakeLists.txt

Modified
examples/CMakeLists.txt

Revision: 0c4e56915a1f6f28
Author: Xi Deng
Date: Oct 01, 2016 (11:49:57 UTC)

skip examples which need GUI when DLIB_NO_GUI_SUPPORT is defined

Modified
examples/CMakeLists.txt

Revision: 56a8a6b0e3c876be
Author: Davis King
Date: Oct 02, 2016 (12:43:11 UTC)

Added comments

Modified
examples/dnn_mmod_dog_hipsterizer.cpp
examples/dnn_mmod_face_detection_ex.cpp

Revision: 35746eebbe5ae72e
Author: Davis King
Date: Oct 02, 2016 (10:33:22 UTC)

Larger mustache :)

Modified
examples/dnn_mmod_dog_hipsterizer.cpp

Revision: 796613c025c742ff
Author: Davis King
Date: Oct 02, 2016 (09:37:47 UTC)

Added test image for dog mmod example program

Added
examples/faces/dogs.jpg

Revision: 1a1ea5f589d10e55
Author: Davis King
Date: Oct 02, 2016 (09:00:07 UTC)

Added more mmod examples.

Modified
examples/CMakeLists.txt
Added
examples/dnn_mmod_dog_hipsterizer.cpp
examples/dnn_mmod_face_detection_ex.cpp

Revision: 4ecbc95dd20e02b2
Author: Davis King
Date: Oct 02, 2016 (08:54:14 UTC)

Simplified the network definition slightly

Modified
examples/dnn_mmod_ex.cpp

Revision: 832dd2b780d5dcc9
Author: Davis King
Date: Oct 02, 2016 (05:25:19 UTC)

Added image_dataset_file::shrink_big_images(). So now load_image_dataset() can load a dataset of high resolution files into a user requested lower resolution.

Modified
dlib/data_io/load_image_dataset.h
dlib/data_io/load_image_dataset_abstract.h

Revision: d1edff75d500b46e
Author: miscellanea
Date: Oct 01, 2016 (10:52:45 UTC)

Add arm files for libpng from official libpng v1.6.7 to support neon (#262) (#264) Now dlib can be compiled for android with -DANDROID_ABI="armeabi-v7a with NEON" with https://github.com/taka-no-me/android-cmake However, when compiling for arm64-v8a, since __ARM_NEON__ is not defined, neon code will not be actually enabled, which requires upgrading libpng a bit more

Modified
dlib/CMakeLists.txt
Added
dlib/external/libpng/arm/arm_init.c
dlib/external/libpng/arm/filter_neon.S
dlib/external/libpng/arm/filter_neon_intrinsics.c

Revision: ae14992c6332d828
Author: Davis King
Date: Oct 01, 2016 (14:33:49 UTC)

Made the check in dnn_trainer for convergence more robust. Previously, if we encountered a bad mini-batch that made the loss value suddenly jump up by a larger than normal value it could make the trainer think we converged. Now the test is robust to recent spikes in loss value.

Modified
dlib/dnn/trainer.h

Revision: 745de03984577150
Author: Davis King
Date: Oct 01, 2016 (14:32:01 UTC)

Added find_upper_quantile() and count_steps_without_decrease_robust().

Modified
dlib/statistics/running_gradient.h
dlib/statistics/running_gradient_abstract.h

Revision: b26b4179004a9a68
Author: Davis King
Date: Oct 01, 2016 (14:00:36 UTC)

Changed DEFAULT_BATCH_NORM_EPS from 1e-5 to 1e-4.

Modified
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h

Revision: 52b7ca67fde80387
Author: Davis King
Date: Oct 01, 2016 (11:12:07 UTC)

Removed the last bit of code with any heritage from numerical recipes in C. This was in some of the svd routines. However, we already had a svd routine that used a separate svd code that is better than the NRIC derived version. So that's what we use everywhere now.

Modified
dlib/matrix/matrix_la.h

Revision: 7a017c493450a5a3
Author: Davis King
Date: Oct 01, 2016 (09:20:16 UTC)

Minor change to avoid warning from gcc

Modified
dlib/test/matrix.cpp

Revision: 5dd0cfca877caab1
Author: Davis King
Date: Sep 30, 2016 (19:09:03 UTC)

Fixed spelling error in comment

Modified
examples/train_shape_predictor_ex.cpp

Revision: 57bd723f7e7d8d75
Author: Davis King
Date: Sep 30, 2016 (17:06:11 UTC)

Minor changes to avoid warnings in visual studio 2015

Modified
dlib/array2d/array2d_kernel.h
dlib/dnn/cuda_dlib.cu
dlib/dnn/cuda_utils.h
dlib/dnn/tensor.h
dlib/matrix/matrix.h

Revision: 16774140d2203404
Author: Davis King
Date: Sep 29, 2016 (04:57:01 UTC)

Fixed spelling error in comment

Modified
dlib/dnn/cuda_utils.h

Revision: 8f5f924a938d99ea
Author: Eugene
Date: Sep 29, 2016 (03:15:25 UTC)

fixed warning about unsigned-signed comparison in imgtool (#258)

Modified
tools/imglab/src/main.cpp

Revision: aae42d24e3e0ae74
Author: Davis King
Date: Sep 28, 2016 (17:14:20 UTC)

Improved error message.

Modified
dlib/dnn/layers.h

Revision: c772c396f47ba1be
Author: Davis King
Date: Sep 28, 2016 (17:13:43 UTC)

Changed default background cropping rate from 0.1 to 0.5.

Modified
dlib/image_transforms/random_cropper.h
dlib/image_transforms/random_cropper_abstract.h

Revision: b84a32d32bde42e2
Author: Davis King
Date: Sep 28, 2016 (17:13:08 UTC)

Added missing requires clauses and asserts.

Modified
dlib/image_transforms/random_cropper.h
dlib/image_transforms/random_cropper_abstract.h

Revision: 8b677387a30aa788
Author: Davis King
Date: Sep 28, 2016 (17:01:49 UTC)

Added --sort-num-objects and cleaned up code slightly.

Modified
tools/imglab/src/main.cpp

Revision: 208920d77ff90da6
Author: Ehsan Azar
Date: Sep 21, 2016 (09:36:24 UTC)

first check large number in elsif (#239)

Modified
dlib/assert.h

Revision: afa9ee5ce6d8ce61
Author: Evgeniy Fominov
Date: Sep 21, 2016 (17:19:13 UTC)

Fixed warning about winsock2.h in windows build (#236)

Modified
dlib/sockets/sockets_kernel_1.cpp

Revision: 703e614feade0698
Author: Davis King
Date: Sep 28, 2016 (05:30:17 UTC)

Made cmake automatically increase clang's template depth limit so the dnn imagenet examples compile.

Modified
dlib/cmake

Revision: 757e906e1148853c
Author: Davis King
Date: Sep 28, 2016 (05:28:40 UTC)

Fixed --cluster not working with relative paths.

Modified
tools/imglab/src/cluster.cpp

Revision: 0cbf2bbfde39e2bf
Author: Davis King
Date: Sep 26, 2016 (16:50:54 UTC)

Added --rmlabel and --rm-if-overlaps. Also changed the behavior of --split so that it simply partitions the data and is an invertible operation.

Modified
tools/imglab/src/main.cpp

Revision: 1a9cff21810532ab
Author: Davis King
Date: Sep 21, 2016 (03:01:54 UTC)

Made thread_pool's destructor call abort() rather than rethrow any exception to avoid compiler warnings.

Modified
dlib/threads/thread_pool_extension.h
dlib/threads/thread_pool_extension_abstract.h

Revision: 2b44381e5800ba86
Author: Davis King
Date: Sep 18, 2016 (07:54:12 UTC)

Made --cluster skip empty images

Modified
tools/imglab/src/cluster.cpp

Revision: b4cc8af1ea94c05a
Author: Davis King
Date: Sep 18, 2016 (05:37:23 UTC)

Improved CLI for --resample

Modified
tools/imglab/src/main.cpp

Revision: 11c1841ef60b2f62
Author: Davis King
Date: Sep 18, 2016 (05:09:39 UTC)

Fixed a bug in --cluster where it would output xml files with empty entries if the input xml file contained unannotated images.

Modified
tools/imglab/src/cluster.cpp

Revision: d84791b084a95bf1
Author: Davis King
Date: Sep 17, 2016 (11:19:52 UTC)

Fixed getting cli warning message when gui closed.

Modified
tools/imglab/src/main.cpp

Revision: 5a82dbc2bb81da11
Author: Davis King
Date: Sep 17, 2016 (05:12:33 UTC)

Made imglab's --resample not skip objects near the edge of the image.

Modified
tools/imglab/src/main.cpp

Revision: c41a595d73a7ac90
Author: Davis King
Date: Sep 16, 2016 (15:45:06 UTC)

Added message about -h

Modified
tools/imglab/src/main.cpp

Revision: dde8f363dbc20329
Author: Davis King
Date: Sep 16, 2016 (02:47:49 UTC)

Made the background crops output by the random_cropper a little more expansive.

Modified
dlib/image_transforms/random_cropper.h

Revision: 7047f2d34a40e711
Author: Davis King
Date: Sep 16, 2016 (02:46:35 UTC)

Added --rmempty to imglab

Modified
tools/imglab/src/main.cpp

Revision: 6709dd779319d5a6
Author: Gregor Fabritius
Date: Sep 13, 2016 (04:04:48 UTC)

Fixed cudnn_hint_path detection for OSX where CUDA_CUBLAS_LIBRARIES is a list, not a single string. (#230)

Modified
dlib/cmake_utils/test_for_cudnn/find_cudnn.txt

Revision: 0632c645f4611695
Author: Davis King
Date: Sep 12, 2016 (16:00:37 UTC)

Made this script more robust

Modified
tools/imglab/copy_imglab_dataset

Revision: b17024aba9803f5b
Author: Davis King
Date: Sep 11, 2016 (04:54:26 UTC)

Added an error message that prints to STDERR when you accidentally let an exception sit in a thread pool and don't handle it before the thread pool is destroyed.

Modified
dlib/threads/thread_pool_extension.h

Revision: 8f1b0437dbbf6719
Author: Davis King
Date: Sep 10, 2016 (13:33:32 UTC)

Made the dnn_trainer propagate exceptions that happen during training (in its training thread) out of the object into the calling code rather than terminating the application.

Modified
dlib/dnn/trainer.h
dlib/dnn/trainer_abstract.h

Revision: 052c2dad2674d347
Author: Davis King
Date: Sep 10, 2016 (11:29:06 UTC)

Made input_rgb_image_pyramid use multiple cores while building the pyramid.

Modified
dlib/dnn/input.h

Revision: 7048cc65daaa69b5
Author: Lucas Clemente Vella
Date: Sep 10, 2016 (12:31:01 UTC)

Adding specific parameters interface on fc_ layer (#213)

Modified
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h

Revision: a10e399cd00a7f13
Author: Davis King
Date: Sep 09, 2016 (16:22:49 UTC)

Fix cmake script so they don't think visual studio 2015 supports C++11, because it doesn't. :(

Modified
dlib/cmake_utils/use_cpp_11.cmake

Revision: 3fd7471574689a16
Author: Gregor Fabritius
Date: Sep 09, 2016 (14:48:29 UTC)

Fixed detection of C++11 features (#224) Detecting C++11 capabilities did not work on OSX 10.11.6, XCode 7.3.1, Apple LLVM 7.3.0, cmake 3.6.1. First check revealed that CMAKE_CXX_KNOWN_FEATURES was empty, so subsequent matches failed. After reading http://public.kitware.com/pipermail/cmake/2014-November/059182.html changed handling to fetch property instead of relying on variable. Works on my machine.

Modified
dlib/cmake_utils/use_cpp_11.cmake

Revision: 5dedeb669dc8342f
Author: Davis King
Date: Sep 07, 2016 (17:12:01 UTC)

Added --min-object-size option to imglab.

Modified
tools/imglab/src/main.cpp

Revision: 2ee81fb13a873e43
Author: Davis King
Date: Sep 06, 2016 (07:41:50 UTC)

Added a warning message to remind users to enable C++11 support.

Modified
dlib/algs.h

Revision: 86b71144e75346ec
Author: Davis King
Date: Sep 06, 2016 (04:15:56 UTC)

Removed compile statements for older versions of visual studio

Modified
dlib/test/WINDOWS_build_and_run_all_unit_tests.bat

Revision: 127f8e4fb9e076c0
Author: Davis King
Date: Sep 06, 2016 (04:13:55 UTC)

Added compiler error messages indicating that newer versions of dlib no longer work with older versions of Visual Studio. This is because C++11 support is too bad in older versions of Visual Studio.

Modified
dlib/algs.h

Revision: 25efb06472834588
Author: Davis King
Date: Sep 06, 2016 (03:03:30 UTC)

Added a check for non-finite values to the trust region solver.

Modified
dlib/optimization/optimization_trust_region.h

Revision: e714cc950c2bc117
Author: Davis King
Date: Sep 05, 2016 (11:40:54 UTC)

Fixed example

Modified
examples/dnn_mmod_ex.cpp

Revision: 82d47f51f8e36f6c
Author: Davis King
Date: Sep 05, 2016 (11:39:31 UTC)

Added random_cropper and DNN MMOD example programs.

Modified
examples/CMakeLists.txt
Added
examples/dnn_mmod_ex.cpp
examples/random_cropper_ex.cpp

Revision: 84e726857717fbc7
Author: Davis King
Date: Sep 05, 2016 (11:38:44 UTC)

Adjusted face boxes so they are a little bit more accurately placed.

Modified
examples/faces/training.xml

Revision: 8e8d1265bbddfffe
Author: Davis King
Date: Sep 05, 2016 (11:00:52 UTC)

Added a call to set_all_bn_running_stats_window_sizes() to set this value to what it was when this example was trained (since I just modified the default value in dlib to something else).

Modified
examples/dnn_imagenet_train_ex.cpp

Revision: 7cb6a3b374735c66
Author: Davis King
Date: Sep 05, 2016 (10:55:53 UTC)

Added a method to set the random_cropper's random seed.

Modified
dlib/image_transforms/random_cropper.h
dlib/image_transforms/random_cropper_abstract.h

Revision: 0ab06c47c3704900
Author: Davis King
Date: Sep 05, 2016 (10:48:17 UTC)

Gave the random_cropper the option to randomly include background patches.

Modified
dlib/image_transforms/random_cropper.h
dlib/image_transforms/random_cropper_abstract.h

Revision: 23974ad798bab91e
Author: Davis King
Date: Sep 05, 2016 (06:15:52 UTC)

Added overload of member function set_chip_dims() and also cleaned up a few minor details.

Modified
dlib/image_transforms/random_cropper.h
dlib/image_transforms/random_cropper_abstract.h

Revision: 0131ae15b53907f1
Author: Davis King
Date: Sep 05, 2016 (06:15:22 UTC)

Added another load_image_dataset() overload for string filenames

Modified
dlib/data_io/load_image_dataset.h
dlib/data_io/load_image_dataset_abstract.h

Revision: c946d61199c1faa6
Author: Davis King
Date: Sep 05, 2016 (05:54:31 UTC)

Renamed loss_binary_mmod_ to loss_mmod_

Modified
dlib/dnn/loss.h
dlib/dnn/loss_abstract.h
dlib/dnn/validation.h
dlib/dnn/validation_abstract.h
dlib/image_processing/full_object_detection_abstract.h

Revision: d263d2c5c848b166
Author: Davis King
Date: Sep 05, 2016 (05:37:30 UTC)

Added a version of test_object_detection_function() for the DNN based MMOD detector.

Modified
dlib/dnn.h
Added
dlib/dnn/validation.h
dlib/dnn/validation_abstract.h

Revision: 5cdd56b819d8fc25
Author: Davis King
Date: Sep 05, 2016 (05:18:57 UTC)

Added an overload of upsample_image_dataset() for mmod_rect annotated datasets.

Modified
dlib/image_transforms/interpolation.h
dlib/image_transforms/interpolation_abstract.h

Revision: 4f0ff3268a1cfcdd
Author: Davis King
Date: Sep 05, 2016 (05:16:44 UTC)

Made input_layer() work in a more reasonable and general way.

Modified
dlib/dnn/core.h
dlib/dnn/core_abstract.h
dlib/dnn/loss.h

Revision: e6e24f679a528b4f
Author: Davis King
Date: Sep 04, 2016 (18:01:12 UTC)

Made cropper not output boxes smaller than it's supposed to. Also cleaned up code a little.

Modified
dlib/image_transforms/random_cropper.h

Revision: b228a7c9b99f8e45
Author: Davis King
Date: Sep 04, 2016 (15:10:15 UTC)

Added random_cropper

Modified
dlib/image_transforms.h
Added
dlib/image_transforms/random_cropper.h
dlib/image_transforms/random_cropper_abstract.h

Revision: cbe12b2a062b1eb1
Author: Davis King
Date: Sep 04, 2016 (13:41:27 UTC)

Added set_all_bn_running_stats_window_sizes() and also changed the default batch normalization running stats window size from 1000 to 100.

Modified
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h

Revision: 6dbfea4bb22c2f9a
Author: Davis King
Date: Sep 04, 2016 (10:52:29 UTC)

Added an overload of load_image_dataset() that outputs directly to mmod_rect instead of rectangle.

Modified
dlib/data_io/load_image_dataset.h
dlib/data_io/load_image_dataset_abstract.h

Revision: 1654442af760f3ea
Author: Davis King
Date: Sep 04, 2016 (10:48:36 UTC)

Moved some code around, added documentation for the mmod loss layer and its attendant objects. Also fixed a minor bug in the loss layer.

Modified
dlib/dnn/loss.h
dlib/dnn/loss_abstract.h
dlib/image_processing/full_object_detection.h
dlib/image_processing/full_object_detection_abstract.h

Revision: afa3967afc6997a7
Author: Davis King
Date: Sep 04, 2016 (10:01:32 UTC)

Added missing assert

Modified
dlib/dnn/input.h

Revision: a4139ba9088a228e
Author: Davis King
Date: Sep 04, 2016 (08:01:49 UTC)

Changed imglab --resample so that it never changes the aspect ratio of an image.

Modified
tools/imglab/src/main.cpp

Revision: a0d16e6dbf1439a3
Author: Davis King
Date: Sep 04, 2016 (07:55:30 UTC)

Fixed error in pyramid_rate() formula.

Modified
dlib/image_transforms/image_pyramid.h
dlib/image_transforms/image_pyramid_abstract.h

Revision: 2cd7f14c9947e0a6
Author: Davis King
Date: Sep 04, 2016 (05:41:38 UTC)

Added get_double_in_range() to dlib::rand.

Modified
dlib/rand/rand_kernel_1.h
dlib/rand/rand_kernel_abstract.h

Revision: 3107e008c2aae596
Author: Davis King
Date: Sep 03, 2016 (05:20:47 UTC)

Added MMOD loss layer

Modified
dlib/dnn/loss.h

Revision: d37ff995dc506e08
Author: Davis King
Date: Sep 03, 2016 (05:02:53 UTC)

Added input_rgb_image_pyramid

Modified
dlib/dnn/input.h
dlib/dnn/input_abstract.h

Revision: d667089afd38fd21
Author: Davis King
Date: Sep 03, 2016 (04:39:58 UTC)

more clarification

Modified
dlib/image_transforms/image_pyramid_abstract.h

Revision: 51a99ae538e25807
Author: Davis King
Date: Sep 03, 2016 (04:37:48 UTC)

clarified spec

Modified
dlib/image_transforms/image_pyramid_abstract.h

Revision: f5fc678498dc52b9
Author: Davis King
Date: Sep 03, 2016 (04:05:30 UTC)

Made load_image_dataset() more generic. Now it can operate on arrays of images that use std::vector in addition to dlib::array.

Modified
dlib/data_io/load_image_dataset.h
dlib/data_io/load_image_dataset_abstract.h

Revision: 4600afc66b79c7e3
Author: Davis King
Date: Sep 03, 2016 (03:52:55 UTC)

Added input_tensor_to_output_tensor() and output_tensor_to_input_tensor() along with the mapping functions necessary at each layer to support these routines.

Modified
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h
dlib/dnn/utilities.h
dlib/dnn/utilities_abstract.h

Revision: f3e40c3157b66be0
Author: Davis King
Date: Sep 03, 2016 (03:14:07 UTC)

Added visit_layers_backwards(), visit_layers_backwards_range(), and visit_layers_range().

Modified
dlib/dnn/core.h
dlib/dnn/core_abstract.h

Revision: d58fccff9e325fe8
Author: jpblackburn
Date: Aug 31, 2016 (18:13:39 UTC)

Add dnn_trainer::train_one_step iterator signature (#212) Add an overload of dnn_trainer::train_one_step that takes a pair of iterators rather than a std::vector.

Modified
dlib/dnn/trainer.h
dlib/dnn/trainer_abstract.h

Revision: 2f9c279aaa846ac9
Author: Davis King
Date: Aug 31, 2016 (07:34:04 UTC)

Changed pinv() so it interprets its tol argument relative to the largest singular value of the input matrix rather than as an absolute tolerance.

Modified
dlib/matrix/matrix_la.h
dlib/matrix/matrix_la_abstract.h

Revision: 443a68b4f7761e12
Author: Davis King
Date: Aug 30, 2016 (18:10:19 UTC)

workaround bugs in visual studio

Modified
dlib/assert.h

Revision: 8717c62459e84fbb
Author: Davis King
Date: Aug 30, 2016 (17:46:26 UTC)

made the build script compile in newer versions of visual studio before older ones.

Modified
dlib/test/WINDOWS_build_and_run_all_unit_tests.bat

Revision: f7a509d6cb76d641
Author: Davis King
Date: Aug 30, 2016 (10:58:38 UTC)

Simplified example to show only the C++11 version of the code.

Modified
examples/parallel_for_ex.cpp

Revision: 19b311e139012a55
Author: Davis King
Date: Aug 30, 2016 (10:44:46 UTC)

Made thread_pool and parallel_for propagate exceptions from task threads to calling code.

Modified
dlib/test/thread_pool.cpp
dlib/threads/parallel_for_extension_abstract.h
dlib/threads/thread_pool_extension.cpp
dlib/threads/thread_pool_extension.h
dlib/threads/thread_pool_extension_abstract.h
examples/thread_pool_ex.cpp

Revision: 39a621bbba8eff85
Author: Davis King
Date: Aug 30, 2016 (06:15:33 UTC)

Added overloads of the parallel for functions that use default_thread_pool()

Modified
dlib/threads/parallel_for_extension.h
dlib/threads/parallel_for_extension_abstract.h

Revision: a6b6efd7482deb1d
Author: Davis King
Date: Aug 29, 2016 (19:34:02 UTC)

Added some comments

Modified
dlib/matlab/mex_wrapper.cpp

Revision: 60eff689078d877e
Author: Davis King
Date: Aug 29, 2016 (19:31:57 UTC)

Added a clone() method to the mex class interface.

Modified
dlib/matlab/mex_wrapper.cpp

Revision: 72e20e746c6fd3cc
Author: Davis King
Date: Aug 29, 2016 (10:15:24 UTC)

Fixed a problem where output matrices don't get assigned anything when they are empty, leading to MATLAB complaining about output arguments to being assigned.

Modified
dlib/matlab/mex_wrapper.cpp

Revision: 5fa3edc19eb93009
Author: Davis King
Date: Aug 29, 2016 (06:56:32 UTC)

Fixed tabbing

Modified
dlib/matlab/mex_wrapper.cpp

Revision: e8a4fa1094c2477f
Author: Davis King
Date: Aug 29, 2016 (05:46:27 UTC)

Added support for binding classes to MATLAB.

Modified
dlib/matlab/CMakeLists.txt
dlib/matlab/mex_wrapper.cpp
Added
dlib/matlab/mex_example_class.cpp

Revision: a05ea5995753e188
Author: Davis King
Date: Aug 28, 2016 (12:56:53 UTC)

Added pyramid_rate(), create_tiled_pyramid(), image_to_tiled_pyramid(), and tiled_pyramid_to_image().

Modified
dlib/image_transforms/image_pyramid.h
dlib/image_transforms/image_pyramid_abstract.h

Revision: 6de599a993c942f0
Author: Davis King
Date: Aug 28, 2016 (10:43:13 UTC)

Fixed compiler warning.

Modified
dlib/dnn/core.h

Revision: 27bad381c9e173d2
Author: Davis King
Date: Aug 28, 2016 (09:28:14 UTC)

Cleaned up assert statements a bit.

Modified
dlib/dnn/core.h
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cublas_dlibapi.cpp
dlib/dnn/cuda_dlib.cu
dlib/dnn/cudnn_dlibapi.cpp
dlib/dnn/gpu_data.cpp
dlib/dnn/gpu_data.h
dlib/dnn/input.h
dlib/dnn/layers.h
dlib/dnn/loss.h
dlib/dnn/solvers.h
dlib/dnn/tensor.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/trainer.h

Revision: 5c74d9b3024f7989
Author: Davis King
Date: Aug 28, 2016 (08:09:02 UTC)

Added nearest_rect()

Modified
dlib/geometry/rectangle.h
dlib/geometry/rectangle_abstract.h

Revision: 2cc3419f93e3d4d3
Author: Davis King
Date: Aug 28, 2016 (08:07:27 UTC)

Made the message argument of the DLIB_ASSERT and DLIB_CASSERT macros optional.

Modified
dlib/assert.h

Revision: 0ec79915109ddf79
Author: Davis King
Date: Aug 27, 2016 (16:13:19 UTC)

Moved impossible_labeling_error to error.h

Modified
dlib/error.h
dlib/svm/structural_svm_object_detection_problem.h
dlib/svm/structural_svm_object_detection_problem_abstract.h

Revision: d70d7afe43c38d10
Author: Davis King
Date: Aug 27, 2016 (12:38:34 UTC)

Added box_intersection_over_union() and also renamed the class members of test_box_overlap so they are less confusing and vague.

Modified
dlib/image_processing/box_overlap_testing.h
dlib/image_processing/box_overlap_testing_abstract.h

Revision: 607c51d65e523d4f
Author: Davis King
Date: Aug 27, 2016 (05:52:18 UTC)

Added alias_tensor_const_instance

Modified
dlib/dnn/tensor.h
dlib/dnn/tensor_abstract.h
dlib/test/dnn.cpp

Revision: c2cdd99160594c54
Author: Davis King
Date: Aug 27, 2016 (05:23:09 UTC)

Made add_loss_layer constructor more flexible. Now you can construct from objects that are implicitly convertible to a loss details object just like you can for computational layers.

Modified
dlib/dnn/core.h
dlib/dnn/core_abstract.h

Revision: 0d5e4cd99e388c3f
Author: Davis King
Date: Aug 27, 2016 (05:10:50 UTC)

Fixed a bug in memcpy() for tensors where you weren't allowed to copy alias tensors. Now any kind of tensors are supported.

Modified
dlib/dnn/gpu_data.cpp
dlib/dnn/gpu_data.h
dlib/dnn/gpu_data_abstract.h
dlib/dnn/tensor.h
dlib/test/dnn.cpp

Revision: 2b15e1983cd410ce
Author: Davis King
Date: Aug 24, 2016 (11:50:24 UTC)

Slightly adjusted some of the unit tests to avoid false failures in some environments.

Modified
dlib/test/correlation_tracker.cpp
dlib/test/matrix2.cpp
dlib/test/oca.cpp
dlib/test/optimization.cpp

Revision: d5c166fd952b9257
Author: Davis King
Date: Aug 24, 2016 (11:36:01 UTC)

Made test_layer() more numerically robust.

Modified
dlib/dnn/core.h

Revision: 5058bd86d75398fc
Author: Davis King
Date: Aug 24, 2016 (11:35:42 UTC)

Updated arch list to simd instructions are dealt with correctly on more platforms.

Modified
dlib/cmake

Revision: 17478a093d7f14c8
Author: Davis King
Date: Aug 24, 2016 (02:56:35 UTC)

fixed typo in example

Modified
examples/train_object_detector.cpp

Revision: 822f2dd0956a9230
Author: Davis King
Date: Aug 23, 2016 (13:01:36 UTC)

merged

Modified
dlib/CMakeLists.txt
dlib/external/libjpeg/jccolor.cpp
dlib/external/libjpeg/jcdctmgr.cpp
dlib/external/libjpeg/jchuff.cpp
dlib/external/libjpeg/jcphuff.cpp
dlib/external/libjpeg/jcprepct.cpp
dlib/external/libjpeg/jcsample.cpp
dlib/external/libjpeg/jdcolor.cpp
dlib/external/libjpeg/jdhuff.cpp
dlib/external/libjpeg/jdhuff.h
dlib/external/libjpeg/jdmerge.cpp
dlib/external/libjpeg/jdphuff.cpp
dlib/external/libjpeg/jdsample.cpp
dlib/external/libjpeg/jquant1.cpp
dlib/external/libjpeg/jquant2.cpp
dlib/external/libjpeg/jutils.cpp
dlib/test/CMakeLists.txt
Deleted
dlib/test/all_source/CMakeLists.txt

Revision: 63e57910a46ec43c
Author: Davis King
Date: Aug 23, 2016 (12:52:24 UTC)

Minor changes to avoid compiler warnings

Modified
dlib/external/libjpeg/jccolor.cpp
dlib/external/libjpeg/jcdctmgr.cpp
dlib/external/libjpeg/jchuff.cpp
dlib/external/libjpeg/jcphuff.cpp
dlib/external/libjpeg/jcprepct.cpp
dlib/external/libjpeg/jcsample.cpp
dlib/external/libjpeg/jdcolor.cpp
dlib/external/libjpeg/jdhuff.cpp
dlib/external/libjpeg/jdhuff.h
dlib/external/libjpeg/jdmerge.cpp
dlib/external/libjpeg/jdphuff.cpp
dlib/external/libjpeg/jdsample.cpp
dlib/external/libjpeg/jquant1.cpp
dlib/external/libjpeg/jquant2.cpp
dlib/external/libjpeg/jutils.cpp

Revision: bda636fb12cfc45b
Author: Davis King
Date: Aug 23, 2016 (11:58:15 UTC)

Improved how the unit tests build all/source.cpp

Modified
dlib/CMakeLists.txt
dlib/test/CMakeLists.txt
Deleted
dlib/test/all_source/CMakeLists.txt

Revision: 73c540c5f71a6ed9
Author: Davis King
Date: Aug 23, 2016 (11:05:55 UTC)

cmake cleanup

Modified
dlib/CMakeLists.txt

Revision: 548254133c54a418
Author: Davis King
Date: Aug 23, 2016 (02:41:19 UTC)

Adjusted test to avoid false alarm

Modified
dlib/test/matrix2.cpp

Revision: 8bc9d6bcdff4299a
Author: Davis King
Date: Aug 22, 2016 (12:47:51 UTC)

Fixed rotate_image() so that it uses the generic image interface rather than expecting an array2d like object.

Modified
dlib/image_transforms/interpolation.h

Revision: 24fbb5545ab5245f
Author: Davis King
Date: Aug 22, 2016 (11:08:20 UTC)

fixed compiler error

Modified
dlib/dnn/cuda_dlib.h

Revision: 8b7a8fd2688d8d1d
Author: Davis King
Date: Aug 22, 2016 (10:53:26 UTC)

Fixed typo in network definition.

Modified
examples/dnn_introduction2_ex.cpp

Revision: 8e940b54b9872718
Author: Davis King
Date: Aug 22, 2016 (10:53:07 UTC)

Fixed compiler warnings

Modified
dlib/dnn/cublas_dlibapi.cpp
dlib/dnn/cudnn_dlibapi.cpp

Revision: f85adb8c5a852e6c
Author: Davis King
Date: Aug 22, 2016 (07:36:56 UTC)

Made the thread local variables that hold the cudnn and cublas context objects not destruct and recreate themselves when you switch devices. Instead, they keep a table of context objects, for each thread and device, reusing as necessary. This prevents churn in the context objects when you are switching back and forth between devices inside a single thread.

Modified
dlib/dnn/cublas_dlibapi.cpp
dlib/dnn/cudnn_dlibapi.cpp

Revision: 3c17706101b4654e
Author: Davis King
Date: Aug 22, 2016 (06:20:41 UTC)

Added cuda bindings: get_device_name(), set_current_device_blocking_sync().

Modified
dlib/dnn/cuda_dlib.cu
dlib/dnn/cuda_dlib.h

Revision: 9980a9953beb5731
Author: Davis King
Date: Aug 22, 2016 (06:11:23 UTC)

Added is_row_major(). Also made sum() run over the matrix in column major order if that's the memory layout of the argument.

Modified
dlib/matrix/matrix_utilities.h
dlib/matrix/matrix_utilities_abstract.h

Revision: 116418659ea343b3
Author: Davis King
Date: Aug 22, 2016 (06:05:56 UTC)

Added an assert on the size of matlab's bools.

Modified
dlib/matlab/mex_wrapper.cpp

Revision: 2f0770cae6ca1c94
Author: Davis King
Date: Aug 21, 2016 (17:03:16 UTC)

Added annotation() to tensor so that you can associate any object you want with a tensor.

Modified
dlib/dnn/tensor.h
dlib/dnn/tensor_abstract.h

Revision: 6ee8d78f5d607b29
Author: Davis King
Date: Aug 21, 2016 (16:48:50 UTC)

Clarified spec

Modified
dlib/dnn/tensor_abstract.h

Revision: 6ccb35f11bacacb2
Author: Davis King
Date: Aug 21, 2016 (16:46:49 UTC)

Added a set_image_size() for sub_image_proxy objects so that they can be written to with assign_image(). However, you get an error if you try to assign an image with a different size.

Modified
dlib/image_transforms/interpolation.h

Revision: 9dee7dbf0c7e13e4
Author: Davis King
Date: Aug 21, 2016 (15:57:18 UTC)

Added comments about thread safety requirements.

Modified
dlib/dnn/input_abstract.h

Revision: 0f97bad460adfff5
Author: Davis King
Date: Aug 21, 2016 (10:59:39 UTC)

Made the coordinate mapping between pyramid layers slightly more accurate.

Modified
dlib/image_transforms/image_pyramid.h

Revision: 100c60cf14d3963a
Author: Davis King
Date: Aug 16, 2016 (14:19:26 UTC)

Fixed more compiler warnings

Modified
dlib/dnn/cuda_dlib.cu
dlib/dnn/cudnn_dlibapi.cpp

Revision: 42fe6ce6dc96f68a
Author: Davis King
Date: Aug 16, 2016 (14:15:59 UTC)

Fixed some compiler warnings

Modified
dlib/dnn/cpu_dlib.cpp

Revision: 64f7d8ac72900162
Author: Davis King
Date: Aug 16, 2016 (14:14:53 UTC)

Made the unit tests compile all/source.cpp.

Modified
dlib/test/CMakeLists.txt
Added
dlib/test/all_source/CMakeLists.txt

Revision: 6385cfd74b2be869
Author: Davis King
Date: Aug 15, 2016 (17:02:42 UTC)

Removed concat1 and inception1 templates to avoid user confusion.

Modified
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h

Revision: bd4cf46b3b1794bb
Author: Davis King
Date: Aug 03, 2016 (07:18:37 UTC)

added missing requirement.

Modified
dlib/dnn/tensor_tools.h

Revision: 69766a9232619917
Author: Davis King
Date: Aug 15, 2016 (14:27:06 UTC)

Made the relational operators constexpr so they don't accidentally cause compilation errors when they get pulled into the scope of template metaprogramming expressions.

Modified
dlib/algs.h

Revision: 88086eb59bdb7fce
Author: Davis King
Date: Aug 15, 2016 (14:08:39 UTC)

updated makefile to give -std=c++11 flag

Modified
dlib/test/makefile

Revision: 095890b2d0548ac5
Author: Davis King
Date: Aug 14, 2016 (15:07:30 UTC)

Changed the DNN API so that sample_expansion_factor is a runtime variable rather than a compile time constant. This also removes it from the input layer interface since the DNN core infers its value at runtime, meaning users that define their own input layers don't need to specify it anymore.

Modified
dlib/dnn/core.h
dlib/dnn/core_abstract.h
dlib/dnn/input.h
dlib/dnn/input_abstract.h
dlib/dnn/layers_abstract.h
dlib/dnn/loss.h
dlib/dnn/loss_abstract.h

Revision: 5e58ca8313c143ec
Author: Davis King
Date: Aug 14, 2016 (09:48:18 UTC)

Made layer_details() part of the SUBNET interface so that user defined layer details objects can access each other. Also added the input_layer() global function for accessing the input layer specifically.

Modified
dlib/dnn/core.h
dlib/dnn/core_abstract.h
dlib/dnn/layers_abstract.h

Revision: 7251a950690b418c
Author: Davis King
Date: Aug 14, 2016 (05:12:51 UTC)

Fixed dlib.range's iterator interface to work in python 3.

Modified
tools/python/src/basic.cpp

Revision: e8e2440b9a96ea72
Author: Davis King
Date: Aug 13, 2016 (10:09:22 UTC)

Record last changeset and set PATCH version to 99

Modified
dlib/CMakeLists.txt
docs/.logger_revnum

Revision: ad6cd2a3bfd54d48
Author: Davis King
Date: Aug 13, 2016 (10:07:28 UTC)

Created release v19.1

Modified
dlib/CMakeLists.txt

Revision: 680e88eb8f297cee
Author: Davis King
Date: Aug 13, 2016 (08:57:21 UTC)

Added a bat file for running all the unit tests through different versions of visual studio.

Modified
.hgignore
Added
dlib/test/WINDOWS_build_and_run_all_unit_tests.bat

Revision: 5cadadf542c69c4c
Author: Davis King
Date: Aug 13, 2016 (08:47:55 UTC)

New versions of boost and cmake need to be told to look in boost's library folder to find boost's libraries when building on windows. Bizarre.

Modified
dlib/cmake_utils/add_python_module

Revision: 0ecf895b3704d7ee
Author: Davis King
Date: Aug 13, 2016 (05:03:16 UTC)

Fixed compiler error on ubuntu 16.04

Modified
tools/imglab/CMakeLists.txt

Revision: d9047c3e80dbfe21
Author: Davis King
Date: Aug 13, 2016 (05:02:57 UTC)

Fixed grammar.

Modified
tools/imglab/src/main.cpp

Revision: 8cdf5a12835e58b6
Author: Davis King
Date: Aug 11, 2016 (18:12:40 UTC)

Added workaround for a bug in cuDNN5.1 which causes cudnnGetConvolutionBackwardFilterAlgorithm() to pick invalid algorithms, resulting in cuDNN not working correctly.

Modified
dlib/dnn/cudnn_dlibapi.cpp
dlib/test/dnn.cpp

Revision: 3b42397e5f6d0014
Author: Davis King
Date: Aug 10, 2016 (05:30:04 UTC)

Added additional search names for boost-python

Modified
dlib/cmake_utils/add_python_module

Revision: 0df486296245ad1f
Author: Davis King
Date: Aug 09, 2016 (12:33:44 UTC)

Fixed a bug in the cuDNN binding that on rare occasions caused NaN outputs from batch normalization. The running mean and variance need to be initialized when calling cuDNN, even if the averaging factor is 1. I don't think this was the case prior to cuDNN v5, but it certainly is the case now. This patch fixes this.

Modified
dlib/dnn/cudnn_dlibapi.cpp

Revision: 6a92b3903c5d22d2
Author: Davis King
Date: Aug 09, 2016 (06:48:48 UTC)

merged

Modified
dlib/test/dnn.cpp

Revision: 7a6e1198de1d01e9
Author: Davis King
Date: Aug 09, 2016 (06:36:38 UTC)

made unit test more repeatable

Modified
dlib/test/matrix_lu.cpp

Revision: 9b4528cc0b9ff705
Author: Davis King
Date: May 25, 2016 (03:07:04 UTC)

made tests more repeatable

Modified
dlib/test/dnn.cpp

Revision: 42025ba5bd122b10
Author: Davis King
Date: Aug 06, 2016 (08:39:13 UTC)

Added more testing messages

Modified
dlib/test/dnn.cpp

Revision: 5c64d900cad38b6f
Author: Davis King
Date: Aug 06, 2016 (08:00:41 UTC)

CMake change to enable cuda use on ubuntu 16.06

Modified
dlib/CMakeLists.txt
dlib/cmake_utils/test_for_cuda/CMakeLists.txt

Revision: a0640f0749627a3d
Author: Davis King
Date: Aug 05, 2016 (15:14:49 UTC)

added missing #include file

Modified
dlib/image_transforms/spatial_filtering.h

Revision: f9f02581bad17a74
Author: Davis King
Date: Aug 05, 2016 (04:13:45 UTC)

Fixed a few places where lab color space still referred to the channels as being signed rather than unsigned.

Modified
dlib/matrix/matrix_utilities.h
dlib/pixel.h

Revision: cbfeed2c5cc36bcb
Author: sutr90
Date: Aug 05, 2016 (12:59:07 UTC)

Added test for RGB to Lab to RGB conversion.

Modified
dlib/test/pixel.cpp

Revision: 48240945b04f98a5
Author: sutr90
Date: Aug 03, 2016 (16:48:59 UTC)

Added tests for Lab pixels.

Modified
dlib/test/pixel.cpp

Revision: baa9e138ca187117
Author: sutr90
Date: Jul 28, 2016 (16:07:23 UTC)

Fixed PNG saving.

Modified
dlib/image_saver/save_png.h

Revision: 39a666b40da798c9
Author: sutr90
Date: Jul 27, 2016 (19:51:01 UTC)

Fixes Lab tests.

Modified
dlib/test/pixel.cpp

Revision: 30ca64a52f1cb5c2
Author: sutr90
Date: Jul 27, 2016 (19:47:42 UTC)

Fixed grayscale assignment.

Modified
dlib/pixel.h

Revision: 2e6d005d8ae72224
Author: sutr90
Date: Jul 27, 2016 (19:25:19 UTC)

Changed lab pixel range. Added clamping on conversion functions.

Modified
dlib/pixel.h

Revision: b8ddd208106126b5
Author: sutr90
Date: Jul 26, 2016 (24:11:56 UTC)

Added missing conversion between HSI and CIELab.

Modified
dlib/pixel.h

Revision: 5973e418ddfffaa4
Author: sutr90
Date: Jul 26, 2016 (23:45:52 UTC)

Added support for CIELab color space pixels.

Modified
dlib/matrix/matrix_utilities.h
dlib/pixel.h
dlib/test/pixel.cpp

Revision: 2f998a6c2b9fc7bc
Author: Davis King
Date: Aug 04, 2016 (17:12:00 UTC)

Added guards so dlib::async code isn't pulled in when using old versions of visual studio (since they don't support c++11).

Modified
dlib/all/source.cpp
dlib/threads.h
dlib/threads/async.cpp
dlib/threads/async.h

Revision: dea3aecb792345f2
Author: Davis King
Date: Aug 04, 2016 (17:10:12 UTC)

Added check for initializer list support so code compiles in visual studio.

Modified
dlib/assert.h
dlib/matrix/matrix.h

Revision: dec488b0a04b48ab
Author: Davis King
Date: Aug 04, 2016 (17:09:52 UTC)

Removed call to std::round() since visual studio 2012 doesn't support it.

Modified
dlib/geometry/point_transforms.h

Revision: ebab1ebf5895864b
Author: Davis King
Date: Jul 31, 2016 (05:49:21 UTC)

Fixed silly typo in script

Modified
tools/imglab/copy_imglab_dataset

Revision: 920eb067626995d9
Author: Davis King
Date: Jul 31, 2016 (05:46:10 UTC)

removed excessive error checking

Modified
tools/imglab/copy_imglab_dataset

Revision: 8592a327373922f7
Author: Davis King
Date: Jul 31, 2016 (05:11:52 UTC)

Made --resample use a 64bit hash of the image data in the file names to make it so there won't ever be any name conflicts in the cropped images.

Modified
tools/imglab/src/main.cpp

Revision: 389426f54db08084
Author: Davis King
Date: Jul 30, 2016 (14:33:50 UTC)

Added some scripts that help with imglab XML file management.

Modified
tools/imglab/CMakeLists.txt
Added
tools/imglab/convert_imglab_paths_to_relative
tools/imglab/copy_imglab_dataset

Revision: 742e2bdfa301bb37
Author: Davis King
Date: Jul 30, 2016 (13:19:20 UTC)

Added --files

Modified
tools/imglab/src/main.cpp

Revision: bb41846587dcc6ce
Author: Davis King
Date: Jul 30, 2016 (10:34:53 UTC)

Added --ignore option. Also improved how scale jittering happens in --resample, now the output images are always the same dimensions but the objects scale changes.

Modified
tools/imglab/src/main.cpp

Revision: 45b26a2734add36a
Author: Davis King
Date: Jul 29, 2016 (05:03:05 UTC)

Made this not use stdin's file descriptor for data transfer between the processes since sometimes stdin was closed in some environments. Also cleaned up the code a little bit.

Modified
dlib/matlab/subprocess_stream.cpp
dlib/matlab/subprocess_stream.h

Revision: a0270d8c59e740fe
Author: Jan Rüegg
Date: Jul 26, 2016 (16:30:20 UTC)

Make filo compile with WIN32_LEAN_AND_MEAN defined (#169)

Modified
dlib/misc_api/misc_api_kernel_1.cpp

Revision: a221b991180b1218
Author: Davis King
Date: Jul 28, 2016 (15:09:07 UTC)

Changed code to avoid advancing iterator beyond end since some compilers complain about this (and it's technically not allowed in C++).

Modified
dlib/dnn/core.h

Revision: 81a2e542ba9ed3c0
Author: Davis King
Date: Jul 28, 2016 (13:59:31 UTC)

fixed grammar in comment

Modified
dlib/cmake_utils/use_cpp_11.cmake

Revision: 804a7ed24b17f3ed
Author: Davis King
Date: Jul 23, 2016 (16:18:31 UTC)

Fixed potential division by zero.

Modified
dlib/statistics/running_gradient.h

Revision: 0d3e88de37146012
Author: Davis King
Date: Jul 23, 2016 (09:34:08 UTC)

fixed typo in comment

Modified
dlib/svm/structural_svm_object_detection_problem.h

Revision: 23fc09e5d35fb92c
Author: Davis King
Date: Jul 22, 2016 (19:01:33 UTC)

Add guard so code compiles in old compilers.

Modified
dlib/test/threads.cpp

Revision: 3fdb9ac329a28cd2
Author: Davis King
Date: Jul 22, 2016 (13:03:34 UTC)

Improved cmake warning messages about cuDNN

Modified
dlib/CMakeLists.txt

Revision: d2e246c66cf245c9
Author: Davis King
Date: Jul 22, 2016 (12:24:25 UTC)

Added dlib::async() and default_thread_pool()

Modified
dlib/CMakeLists.txt
dlib/all/source.cpp
dlib/test/thread_pool.cpp
dlib/test/threads.cpp
dlib/threads.h
Added
dlib/threads/async.cpp
dlib/threads/async.h
dlib/threads/async_abstract.h

Revision: 7cf1fd98846fee25
Author: Davis King
Date: Jul 22, 2016 (12:22:57 UTC)

Renamed something to avoid name clash with standard library.

Modified
examples/threads_ex.cpp

Revision: 5a0b03db37fcd528
Author: Evgeniy Fominov
Date: Jul 22, 2016 (19:11:13 UTC)

Shape predictor trainer optimizations (#126) * Shape predictor trainer optimizations * Fixed performance leak in single thread mode & made VS2010 support

Modified
dlib/image_processing/shape_predictor.h
dlib/image_processing/shape_predictor_abstract.h
examples/train_shape_predictor_ex.cpp

Revision: cf183da2f015aad5
Author: Davis King
Date: Jul 21, 2016 (13:10:51 UTC)

Made it so the matrix only uses matlab's allocation routines for matrices that are directly the arguments of a mex function. This way, we avoid the problem of dlib::matrix objects being created in other threads that internally call into matlab and mess it up (since matlab is not thread safe in any sense).

Modified
dlib/matlab/mex_wrapper.cpp
dlib/matrix/matrix.h
dlib/matrix/matrix_data_layout.h

Revision: c1b48f3aa17a53ea
Author: Davis King
Date: Jul 20, 2016 (11:33:45 UTC)

Fixed path error in this cmake file.

Modified
dlib/matlab/cmake_mex_wrapper

Revision: 8363dd6fefa23d82
Author: Davis King
Date: Jul 21, 2016 (18:32:48 UTC)

Made remove_unobtainable_rectangles() work with all scan_fhog_pyramid objects.

Modified
dlib/image_processing/remove_unobtainable_rectangles.h

Revision: 4d582db4bb95cb8d
Author: Davis King
Date: Jul 21, 2016 (18:32:25 UTC)

Improved --extract-chips and --resample a bit.

Modified
tools/imglab/src/main.cpp

Revision: 8a27cd5b0c42b1bd
Author: Davis King
Date: Jul 20, 2016 (11:12:32 UTC)

Made the env var CUDA_VISIBLE_DEVICES propagate to the child process

Modified
dlib/matlab/subprocess_stream.cpp

Revision: de575b215a3e16c2
Author: Davis King
Date: Jul 20, 2016 (16:28:08 UTC)

Added missing const.

Modified
dlib/filtering/rls_filter.h
dlib/filtering/rls_filter_abstract.h

Revision: 0e022a150261af3a
Author: Davis King
Date: Jul 20, 2016 (06:19:46 UTC)

Minor change to avoid linker errors in some cases.

Modified
dlib/pixel.h

Revision: 5e9022be8efd95ac
Author: Minglangjun Li
Date: Jul 20, 2016 (30:05:30 UTC)

Fixes #128. Added support to discontiguous Numpy arrays (#155)

Modified
dlib/python/numpy.h
dlib/python/numpy_image.h

Revision: cb56f23ae90b1d7c
Author: Davis King
Date: Jul 16, 2016 (05:06:29 UTC)

Renamed iterator types to correctly reflect their requirements (i.e. not input iterators in the sense implied by the C++ standard but rather at least forward iterators).

Modified
dlib/dnn/core.h
dlib/dnn/core_abstract.h
dlib/dnn/input.h
dlib/dnn/input_abstract.h

Revision: a0468ff0f9378b70
Author: Davis King
Date: Jul 16, 2016 (04:58:17 UTC)

Improved error message

Modified
dlib/dnn/cuda_dlib.cu

Revision: 729a452551a63e54
Author: vsooda
Date: Jul 12, 2016 (29:46:06 UTC)

fix shape_predictor dlib::searialize and dlib::desearialize error (#156) * fix shape_predictor dlib::searialize and dlib::desearialize error * declare shape_predictor searialize and desearialize inline * fix inline declare issue: declare inline before implement

Modified
dlib/image_processing/shape_predictor.h

Revision: 9fd60eec1b2de368
Author: Davis King
Date: Jul 10, 2016 (03:46:31 UTC)

Added checks to see if cblas.h has already been #included.

Modified
dlib/matrix/cblas_constants.h
dlib/matrix/matrix_blas_bindings.h
dlib/matrix/matrix_trsm.h

Revision: fc6e5577adf9270b
Author: Davis King
Date: Jul 07, 2016 (15:29:42 UTC)

Updated search paths for the Intel MKL so they will find newer versions of the MKL on windows.

Modified
dlib/cmake_utils/cmake_find_blas.txt

Revision: 7763c50984e5209a
Author: Fm
Date: Jun 28, 2016 (15:47:49 UTC)

Merge branch 'master' of https://github.com/davisking/dlib

Modified
.hgtags
dlib/CMakeLists.txt
dlib/dnn/cpu_dlib.h
dlib/dnn/input.h
dlib/image_processing/render_face_detections.h
dlib/image_transforms/random_color_transform.h
dlib/simd/simd8f.h
dlib/test/matrix_qr.cpp
dlib/use_cpp_11.cmake
docs/.logger_revnum
docs/docs/faq.xml
docs/docs/imaging.xml
docs/docs/index.xml
docs/docs/main_menu.xml
docs/docs/ml.xml
docs/docs/optimization.xml
docs/docs/release_notes.xml
docs/docs/term_index.xml
docs/makerel
examples/CMakeLists.txt
examples/dnn_imagenet_ex.cpp
examples/dnn_inception_ex.cpp
python_examples/face_landmark_detection.py
Added
examples/dnn_imagenet_train_ex.cpp
examples/dnn_introduction2_ex.cpp
examples/dnn_introduction_ex.cpp
Deleted
examples/dnn_mnist_advanced_ex.cpp
examples/dnn_mnist_ex.cpp

Revision: 794ff3ee4b92a489
Author: Fm
Date: Jun 21, 2016 (13:42:09 UTC)

DNN Visual Studio 2015 UP3 support

Modified
dlib/dnn/core.h
dlib/use_cpp_11.cmake

Revision: 95da024d50f9a1d9
Author: Davis King
Date: Jul 05, 2016 (03:03:38 UTC)

Made this cmake script always enable whatever partial C++11 support your compiler has.

Modified
dlib/cmake_utils/use_cpp_11.cmake

Revision: 7e5d93b9241702b5
Author: Davis King
Date: Jul 04, 2016 (08:19:50 UTC)

Added --extract-chips option to imglab.

Modified
tools/imglab/src/main.cpp

Revision: ad3195ff2ec9bd04
Author: Davis King
Date: Jul 04, 2016 (04:35:45 UTC)

Fixed bugs in the new --resample option

Modified
tools/imglab/src/main.cpp

Revision: bd21b2c5fbdf39c5
Author: Davis King
Date: Jul 03, 2016 (15:26:49 UTC)

Added the --resample option

Modified
tools/imglab/src/main.cpp

Revision: 6143ef322d8c2fa8
Author: Davis King
Date: Jul 03, 2016 (15:26:21 UTC)

Made it so that input<array2d> and input<matrix> layers can be converted between each other.

Modified
dlib/dnn/input.h

Revision: eb716b09234f9b0e
Author: Davis King
Date: Jul 03, 2016 (15:22:00 UTC)

Added rectangle_transform

Modified
dlib/geometry/point_transforms.h
dlib/geometry/point_transforms_abstract.h

Revision: 5a763c5bb65d6987
Author: Davis King
Date: Jun 28, 2016 (16:17:03 UTC)

Moved the auxiliary cmake into a common folder.

Modified
dlib/CMakeLists.txt
dlib/cmake
tools/python/CMakeLists.txt
Added
dlib/cmake_utils/add_global_compiler_switch.cmake
dlib/cmake_utils/add_python_module
dlib/cmake_utils/cmake_find_blas.txt
dlib/cmake_utils/dlib.pc.in
dlib/cmake_utils/dlibConfig.cmake.in
dlib/cmake_utils/release_build_by_default
dlib/cmake_utils/tell_visual_studio_to_use_static_runtime.cmake
dlib/cmake_utils/test_for_cpp11/CMakeLists.txt
dlib/cmake_utils/test_for_cpp11/cpp11_test.cpp
dlib/cmake_utils/test_for_cuda/CMakeLists.txt
dlib/cmake_utils/test_for_cuda/cuda_test.cu
dlib/cmake_utils/test_for_cudnn/CMakeLists.txt
dlib/cmake_utils/test_for_cudnn/find_cudnn.txt
dlib/cmake_utils/use_cpp_11.cmake
Deleted
dlib/add_global_compiler_switch.cmake
dlib/add_python_module
dlib/cmake_find_blas.txt
dlib/dlib.pc.in
dlib/dlibConfig.cmake.in
dlib/dnn/test_for_cpp11/CMakeLists.txt
dlib/dnn/test_for_cpp11/cpp11_test.cpp
dlib/dnn/test_for_cuda/CMakeLists.txt
dlib/dnn/test_for_cuda/cuda_test.cu
dlib/dnn/test_for_cudnn/CMakeLists.txt
dlib/dnn/test_for_cudnn/find_cudnn.txt
dlib/release_build_by_default
dlib/tell_visual_studio_to_use_static_runtime.cmake
dlib/use_cpp_11.cmake

Revision: ed6f144a0a307167
Author: Davis King
Date: Jun 27, 2016 (06:17:48 UTC)

Fixed missing part of spec

Modified
dlib/dnn/layers_abstract.h

Revision: b0f5471654baacc9
Author: Davis King
Date: Jun 25, 2016 (14:31:21 UTC)

Added some more comments

Modified
examples/dnn_imagenet_ex.cpp

Revision: 45d625c505fbec4a
Author: Davis King
Date: Jun 25, 2016 (11:05:14 UTC)

Record last changeset and set PATCH version to 99

Modified
dlib/CMakeLists.txt
docs/.logger_revnum

Revision: 7210589728f6d83f
Author: Davis King
Date: Jun 25, 2016 (11:03:30 UTC)

Created release v19.0

Modified
dlib/CMakeLists.txt

Revision: 657c608fec03e34a
Author: Davis King
Date: Jun 25, 2016 (10:16:43 UTC)

fixed tabbing

Modified
dlib/dnn/cpu_dlib.h

Revision: f54faf884ed106bf
Author: Davis King
Date: Jun 25, 2016 (10:00:38 UTC)

Changed URLs to point to dlib.net instead of sourceforge.net

Modified
python_examples/face_landmark_detection.py

Revision: 8e7a0b7f1b36fd89
Author: Davis King
Date: Jun 25, 2016 (09:03:12 UTC)

fixed compiler warning

Modified
examples/dnn_imagenet_train_ex.cpp

Revision: 935447da3526dd72
Author: Davis King
Date: Jun 25, 2016 (08:31:59 UTC)

Changed code so the validation listing file doesn't have to be in the imagenet root folder.

Modified
examples/dnn_imagenet_train_ex.cpp

Revision: d112ab11d2160ed3
Author: Davis King
Date: Jun 25, 2016 (08:28:00 UTC)

Fixed bug in apply_random_color_offset(), it computed slightly wrong outputs.

Modified
dlib/image_transforms/random_color_transform.h

Revision: 349648ad122bf778
Author: Davis King
Date: Jun 25, 2016 (07:17:07 UTC)

fixed compiler warnings

Modified
dlib/dnn/input.h
examples/dnn_imagenet_train_ex.cpp

Revision: 760b4cdb0a564200
Author: Davis King
Date: Jun 25, 2016 (05:47:36 UTC)

Minor formatting cleanup

Modified
examples/dnn_imagenet_ex.cpp

Revision: 40636e2e9f9060d0
Author: Davis King
Date: Jun 25, 2016 (05:42:22 UTC)

fixed typo

Modified
examples/dnn_imagenet_train_ex.cpp
examples/dnn_introduction2_ex.cpp

Revision: bcfee9140836f78e
Author: Davis King
Date: Jun 25, 2016 (05:40:11 UTC)

Updated examples to refer to the correct file names.

Modified
examples/dnn_imagenet_ex.cpp
examples/dnn_imagenet_train_ex.cpp
examples/dnn_inception_ex.cpp
examples/dnn_introduction2_ex.cpp

Revision: 9f785654dc6b1746
Author: Davis King
Date: Jun 25, 2016 (05:34:53 UTC)

renamed examples

Modified
examples/CMakeLists.txt
Added
examples/dnn_introduction2_ex.cpp
examples/dnn_introduction_ex.cpp
Deleted
examples/dnn_mnist_advanced_ex.cpp
examples/dnn_mnist_ex.cpp

Revision: c497ce79d35ae74e
Author: Davis King
Date: Jun 25, 2016 (05:26:51 UTC)

Added the program that made the resnet model.

Modified
examples/CMakeLists.txt
examples/dnn_imagenet_ex.cpp
Added
examples/dnn_imagenet_train_ex.cpp

Revision: 534ebf664f47aefb
Author: Davis King
Date: Jun 24, 2016 (06:51:03 UTC)

Changed test to avoid failure in visual studio.

Modified
dlib/test/matrix_qr.cpp

Revision: 52c3bd988a107cb2
Author: Davis King
Date: Jun 24, 2016 (-03:28:52 UTC)

Changed the message that cmake displays when opencv isn't found so users don't get confused.

Modified
examples/CMakeLists.txt

Revision: 567abd857dc34a8d
Author: Davis King
Date: Jun 24, 2016 (-03:24:03 UTC)

Added check back in since visual studio doesn't really work with the C++11 code in dlib.

Modified
dlib/use_cpp_11.cmake

Revision: e8baacc72fc1b2be
Author: Davis King
Date: Jun 23, 2016 (05:42:38 UTC)

A minor change to avoid a compiler error in clang

Modified
dlib/simd/simd8f.h

Revision: c70732018c46b64e
Author: GurunathB
Date: Jun 23, 2016 (26:32:12 UTC)

Updated comments to specify the position of points (#141) Updated comments to specify the position of points on the face for 68 points generated by the face landmark detector.

Modified
dlib/image_processing/render_face_detections.h

Revision: c086d238f6b64dee
Author: Davis King
Date: Jun 22, 2016 (18:30:45 UTC)

Added some comments

Modified
examples/dnn_imagenet_ex.cpp

Revision: b4e8042977086fdf
Author: Davis King
Date: Jun 22, 2016 (18:26:48 UTC)

Added an example showing how to classify imagenet images.

Modified
examples/CMakeLists.txt
Added
examples/dnn_imagenet_ex.cpp

Revision: dc90a5abe21b758b
Author: Davis King
Date: Jun 22, 2016 (18:20:19 UTC)

Added input_rgb_image_sized.

Modified
dlib/dnn/input.h
dlib/dnn/input_abstract.h

Revision: 96d7741e06057500
Author: nxwhite-str
Date: Jun 22, 2016 (17:17:16 UTC)

Add detection threshold adjustment to object detection python interface (#140) * Add cmake option to use external libjpeg on Mac OS * Add adjust_threshold to python object detector * Add cmake option to use external libjpeg on Mac OS * Add adjust_threshold to python object detector * Revert "Add cmake option to use external libjpeg on Mac OS" This reverts commit 01f7fd13ea3f2b519312900333f9b68847fd1633. * Update detector example to set adjust_threshold

Modified
python_examples/face_detector.py
tools/python/src/object_detection.cpp
tools/python/src/simple_object_detector_py.h

Revision: 2908d73bbbf5c26f
Author: Davis King
Date: Jun 22, 2016 (17:43:51 UTC)

Removed support for old serialization formats in many of the DNN objects. This is to clean up the code since it was getting somewhat complex and this is the last opportunity to do this kind of cleanup prior to the release of dlib v19.0. If you have saved network objects and want to convert them to the current format, then make sure you checkout the previous commit (labeled with tag before_dnn_serialization_cleanup) and then deserialize and serialize your network back to disk.

Modified
dlib/dnn/layers.h
dlib/dnn/trainer.h

Revision: 4d6b102506bb9e2f
Author: Davis E. King
Date: Jun 22, 2016 (07:47:38 UTC)

Merge pull request #139 from e-fominov/dnn_vs2015_up3 DNN Visual Studio 2015 Update3 support

Modified
dlib/cmake
dlib/dnn.h
dlib/dnn/core.h
dlib/dnn/layers.h
dlib/use_cpp_11.cmake
examples/CMakeLists.txt
examples/dnn_inception_ex.cpp
examples/dnn_mnist_advanced_ex.cpp

Revision: 14afea5ff3b87e1c
Author: Fm
Date: Jun 22, 2016 (21:09:26 UTC)

#pragma warning moved to dnn.h

Modified
dlib/dnn.h
examples/dnn_inception_ex.cpp
examples/dnn_mnist_advanced_ex.cpp

Revision: ae8d58db4973c70b
Author: Fm
Date: Jun 22, 2016 (20:54:28 UTC)

removed wrong empty line

Modified
examples/dnn_inception_ex.cpp

Revision: a633a6714320720b
Author: Fm
Date: Jun 22, 2016 (20:53:37 UTC)

removed comment form net printing

Modified
examples/dnn_inception_ex.cpp

Revision: d404e2d676b8984a
Author: Fm
Date: Jun 22, 2016 (20:51:06 UTC)

#pragma warning for C4503 and /bigobj

Modified
dlib/cmake
examples/CMakeLists.txt
examples/dnn_inception_ex.cpp
examples/dnn_mnist_advanced_ex.cpp

Revision: 3c0ffd41063b88e4
Author: Fm
Date: Jun 22, 2016 (20:22:43 UTC)

Added compiler flags for VS compiling DNN samples without warnings

Modified
examples/CMakeLists.txt

Revision: a40d55b25999dff6
Author: Fm
Date: Jun 22, 2016 (19:53:27 UTC)

Fixed layer constructors to support VS2015

Modified
dlib/cmake
dlib/dnn/core.h

Revision: 1251abd05a506bf0
Author: Fm
Date: Jun 21, 2016 (22:35:36 UTC)

removed commented code

Modified
dlib/dnn/layers.h

Revision: 702f2732971ff655
Author: Fm
Date: Jun 21, 2016 (22:15:25 UTC)

Visual studio now compiles dnn_mnist_advanced, inception and dtest

Modified
dlib/cmake
dlib/dnn/layers.h

Revision: 4da85b5391e84ac9
Author: Fm
Date: Jun 21, 2016 (13:49:01 UTC)

Visual Studio 2015 UP3 support

Modified
dlib/dnn/core.h
dlib/use_cpp_11.cmake

Revision: a9767ba602e13b1d
Author: Davis King
Date: Jun 22, 2016 (07:09:49 UTC)

Changed conv layer to use cross-correlation rather than convolution.

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cudnn_dlibapi.cpp
dlib/dnn/layers.h

Revision: c380016096f46a88
Author: Davis King
Date: Jun 19, 2016 (04:55:42 UTC)

Made it so the image_display lets you add parts outside the object's bounding box.

Modified
dlib/gui_widgets/widgets.cpp

Revision: 0aa0400268ffbade
Author: Davis King
Date: Jun 13, 2016 (08:25:44 UTC)

Made subprocess_stream echo stuff written to the child's cout to the parent's cout. Also just made it a little nicer with regard to error handling.

Modified
dlib/matlab/subprocess_stream.cpp
dlib/matlab/subprocess_stream.h

Revision: 5acc96d2156973bb
Author: Davis King
Date: Jun 11, 2016 (19:08:51 UTC)

Moved log1pexp() and randomize_parameters() from core.h into utilities.h

Modified
dlib/dnn/core.h
dlib/dnn/core_abstract.h
dlib/dnn/layers.h
dlib/dnn/utilities.h
dlib/dnn/utilities_abstract.h

Revision: 10fd985ffb498a15
Author: Davis King
Date: Jun 11, 2016 (18:47:52 UTC)

Added net_to_xml()

Modified
dlib/dnn.h
dlib/dnn/input.h
dlib/dnn/input_abstract.h
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h
dlib/dnn/loss.h
dlib/dnn/loss_abstract.h
Added
dlib/dnn/utilities.h
dlib/dnn/utilities_abstract.h

Revision: 44d9fba2b8ffed0d
Author: Davis King
Date: Jun 11, 2016 (18:13:48 UTC)

Made layer() work on const networks.

Modified
dlib/dnn/core.h

Revision: 9bbee06740b5ca74
Author: Davis King
Date: Jun 11, 2016 (17:15:36 UTC)

Made mat() work on empty tensors.

Modified
dlib/dnn/tensor.h
dlib/dnn/tensor_abstract.h

Revision: 1d215f63e5f3cf9f
Author: Davis King
Date: Jun 11, 2016 (17:15:04 UTC)

Adjusted asserts to allow mat() to output empty matrices.

Modified
dlib/matrix/matrix_mat.h
dlib/matrix/matrix_mat_abstract.h

Revision: 8fae9e8b82cf0d1d
Author: Davis King
Date: Jun 11, 2016 (08:58:59 UTC)

Added visit_layers()

Modified
dlib/dnn/core.h
dlib/dnn/core_abstract.h

Revision: 6e3bc66aa6b93b34
Author: Davis King
Date: Jun 11, 2016 (07:56:04 UTC)

clarified spec

Modified
dlib/dnn/core_abstract.h

Revision: 05a5e5363690cbc4
Author: Davis King
Date: Jun 11, 2016 (07:54:44 UTC)

updated example comments

Modified
examples/dnn_mnist_advanced_ex.cpp

Revision: 54ddafdee10fdf93
Author: Davis King
Date: Jun 11, 2016 (07:54:32 UTC)

Added tag_id and made skip and add_prev layers print their id numbers when written to an output stream.

Modified
dlib/dnn/core.h
dlib/dnn/core_abstract.h
dlib/dnn/layers.h

Revision: e148425be8ece75f
Author: Davis King
Date: Jun 11, 2016 (05:37:44 UTC)

cleanup

Modified
dlib/dnn/core.h

Revision: c5e3341d3f6a6adb
Author: Davis King
Date: Jun 11, 2016 (04:04:51 UTC)

Updated tests now that the resizable_tensor has an assignment mode that automatically sizes the tensor.

Modified
dlib/test/dnn.cpp

Revision: d04c251b841a4a2a
Author: Davis King
Date: Jun 11, 2016 (04:04:22 UTC)

Made the resizable_tensor's assignment operator work in a more sensible way.

Modified
dlib/dnn/tensor.h
dlib/dnn/tensor_abstract.h

Revision: 24dbc7dc8b677c6a
Author: Davis King
Date: Jun 11, 2016 (04:03:40 UTC)

Made fill_gaussian() default to a standard normal distribution.

Modified
dlib/dnn/curand_dlibapi.h
dlib/dnn/tensor_tools.h

Revision: 4c257702f516cbb9
Author: Davis King
Date: Jun 11, 2016 (03:39:56 UTC)

Made this bit of the code a little clearer.

Modified
dlib/simd/simd_check.h

Revision: 283bae2f1b502e95
Author: Davis King
Date: Jun 10, 2016 (17:26:12 UTC)

Removed this include statement since it causes errors on some systems.

Modified
dlib/simd/simd_check.h

Revision: e1c0dd50c8123cdf
Author: Davis King
Date: Jun 10, 2016 (16:52:10 UTC)

Made imglab assign a random color to boxes with labels.

Modified
tools/imglab/src/metadata_editor.cpp

Revision: d4da2bf6089d0438
Author: Davis King
Date: Jun 10, 2016 (16:49:20 UTC)

Made holding ctrl and clicking on an overlay rectangle set the color to the default value as well as the label to the default.

Modified
dlib/gui_widgets/widgets.cpp
dlib/gui_widgets/widgets_abstract.h

Revision: c5e398c5ad20a2f9
Author: Davis King
Date: Jun 10, 2016 (12:40:50 UTC)

Fixed minor bugs in join_rows() and join_cols(). They didn't work when one of the matrices was empty.

Modified
dlib/matrix/matrix_utilities.h

Revision: bfab04ee3fd00c15
Author: Davis King
Date: Jun 10, 2016 (08:42:02 UTC)

fixed compiler warning

Modified
dlib/matrix/matrix_eigenvalue.h

Revision: ed3a22282755bfa9
Author: Davis King
Date: Jun 10, 2016 (07:00:53 UTC)

Made resizable_tensor construction and assignment from matrices automatically set the size of the tensor.

Modified
dlib/dnn/tensor.h
dlib/dnn/tensor_abstract.h

Revision: 7abc9cdc99ca5431
Author: Davis King
Date: Jun 07, 2016 (11:37:46 UTC)

fixed warning and typo in comment

Modified
dlib/error.h
dlib/matlab/subprocess_stream.h

Revision: dc6d459bdd37748f
Author: Davis King
Date: Jun 07, 2016 (08:08:40 UTC)

Fixed missing return statement

Modified
dlib/smart_pointers/shared_ptr_thread_safe.h

Revision: 95fcd08cfe9b8131
Author: Davis King
Date: Jun 07, 2016 (05:01:21 UTC)

Made CMake's search for cuDNN a little more broad

Modified
dlib/dnn/test_for_cudnn/find_cudnn.txt

Revision: 769251e198953ca9
Author: Davis King
Date: Jun 07, 2016 (02:27:24 UTC)

Made tests less likely to false alarm.

Modified
dlib/test/bayes_nets.cpp

Revision: a2c3f8205bd8bd6a
Author: Davis King
Date: Jun 06, 2016 (17:18:09 UTC)

Made this bit of code not look crazy

Modified
dlib/dnn/cpu_dlib.cpp

Revision: 51deedd8836012e1
Author: Davis King
Date: Jun 05, 2016 (12:39:10 UTC)

Fixed solvers so they apply the bias specific multipliers to the correct parts of the parameter vectors.

Modified
dlib/dnn/solvers.h

Revision: 0734470533650bc7
Author: AbdealiJK
Date: Jun 05, 2016 (28:68:09 UTC)

save_jpeg: Use TRUE instead of true In some verisons on jpeg, TRUE is an enum, and so `true` fails because it is not of the enum's type. Now, all the libjpeg calls use TRUE/FALSE. Fixes https://github.com/davisking/dlib/issues/129

Modified
dlib/image_saver/save_jpeg.cpp

Revision: 4df0b675c5585b34
Author: Davis King
Date: Jun 05, 2016 (03:45:15 UTC)

Made the steps without progress counter reset immediately upon changing the learning rate.

Modified
dlib/dnn/trainer.h

Revision: 45b0db5d2ba20909
Author: Davis King
Date: Jun 01, 2016 (02:51:46 UTC)

made tests more repeatable

Modified
dlib/test/dnn.cpp

Revision: 9017ee37672b6536
Author: Davis King
Date: May 31, 2016 (08:40:48 UTC)

fixed compile time error

Modified
dlib/matlab/subprocess_stream.h

Revision: 763f4c6984a81014
Author: Davis King
Date: May 31, 2016 (08:37:25 UTC)

Added subprocess_stream so that complex things can be isolated from MATLAB's shenanigans in a separate process.

Added
dlib/matlab/subprocess_stream.cpp
dlib/matlab/subprocess_stream.h

Revision: f5f7f0af60574181
Author: Davis King
Date: May 31, 2016 (08:27:59 UTC)

Made the mex wrapper trap all std::exception derived exceptions rather than just dlib exceptions.

Modified
dlib/matlab/mex_wrapper.cpp

Revision: 64027e70595b7888
Author: Davis King
Date: May 31, 2016 (02:45:02 UTC)

Made imglab show the name of the current image in the title bar.

Modified
tools/imglab/src/main.cpp
tools/imglab/src/metadata_editor.cpp

Revision: 38a6da59fda1fc3e
Author: Davis King
Date: May 30, 2016 (09:14:04 UTC)

minor cleanup

Modified
examples/dnn_inception_ex.cpp

Revision: 22868c99e2671f1d
Author: Davis King
Date: May 30, 2016 (07:39:16 UTC)

clarified spec

Modified
dlib/dnn/tensor_abstract.h

Revision: dd8ebb421e62df84
Author: Davis King
Date: May 30, 2016 (05:24:19 UTC)

fixed typo

Modified
dlib/dnn/layers_abstract.h

Revision: a37f304c93a471bf
Author: Davis King
Date: May 30, 2016 (05:17:46 UTC)

A little more cleanup in the spec

Modified
dlib/dnn/layers_abstract.h

Revision: fcd9cac1209ad70b
Author: Davis King
Date: May 30, 2016 (04:54:02 UTC)

fixed typo

Modified
dlib/dnn/tensor_tools.h

Revision: 9ff207d88a180dd7
Author: Davis King
Date: May 30, 2016 (04:50:49 UTC)

clarified spec

Modified
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h

Revision: e2263ff9f026587b
Author: Davis King
Date: May 30, 2016 (04:50:28 UTC)

Clarified some parts of the example.

Modified
examples/dnn_inception_ex.cpp

Revision: 98f6ba7640ae5482
Author: Fm
Date: May 29, 2016 (20:21:42 UTC)

Replaced sizeof... with variadic templates

Modified
dlib/dnn/layers.h

Revision: 4a1e8f032a7503de
Author: Fm
Date: May 27, 2016 (17:49:11 UTC)

Removed friend declaration of dnn_tester from core.h

Modified
dlib/dnn/core.h
dlib/test/dnn.cpp

Revision: 20baf67694b60a0f
Author: Fm
Date: May 27, 2016 (12:55:15 UTC)

Changed concat syntax into concat1, concat2..., made dtest more readable::

Modified
dlib/dnn/core.h
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h
dlib/test/dnn.cpp
examples/dnn_inception_ex.cpp

Revision: e445f5915620bb31
Author: Fm
Date: May 26, 2016 (22:40:10 UTC)

Added layer access and printing examples to inception sample

Modified
examples/dnn_inception_ex.cpp

Revision: 17828db2f61a2744
Author: Evgeniy Fominov
Date: May 26, 2016 (21:26:08 UTC)

Fixed dnn_tester in GPU mode for cpu_tensor test

Modified
dlib/test/dnn.cpp

Revision: 66435f70abd6303a
Author: Fm
Date: May 26, 2016 (20:51:44 UTC)

fixed cuda::copy_tensor

Modified
dlib/dnn/cuda_dlib.h

Revision: 63be501a69605ade
Author: Fm
Date: May 26, 2016 (20:43:54 UTC)

depth_group replaced with concat layer

Modified
dlib/dnn/core.h
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cpu_dlib.h
dlib/dnn/cuda_dlib.cu
dlib/dnn/cuda_dlib.h
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h
dlib/test/dnn.cpp
examples/dnn_inception_ex.cpp

Revision: ce9fd4d4cfe2fbe0
Author: Fm
Date: May 26, 2016 (20:15:56 UTC)

Merge branch 'master' of https://github.com/davisking/dlib into dnn_group_layer

Modified
dlib/algs.h
dlib/dnn/core.h
dlib/dnn/core_abstract.h
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cpu_dlib.h
dlib/dnn/cuda_dlib.cu
dlib/dnn/cuda_dlib.h
dlib/dnn/cudnn_dlibapi.cpp
dlib/dnn/cudnn_dlibapi.h
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h
dlib/dnn/solvers.h
dlib/dnn/solvers_abstract.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h
dlib/dnn/trainer.h
dlib/optimization/optimization.h
dlib/optimization/optimization_abstract.h
dlib/test/dnn.cpp
examples/dnn_mnist_advanced_ex.cpp
examples/webcam_face_pose_ex.cpp
Added
tools/visual_studio_natvis/README.txt
tools/visual_studio_natvis/dlib.natvis

Revision: ccae12930d226e99
Author: Fm
Date: May 17, 2016 (16:36:48 UTC)

depth layer: cuda concat/split moved to cpu/cuda files

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cpu_dlib.h
dlib/dnn/cuda_dlib.cu
dlib/dnn/cuda_dlib.h
dlib/dnn/tensor_tools.cpp

Revision: 1b0d06e416ec8c11
Author: Fm
Date: May 17, 2016 (16:07:04 UTC)

Grouping layer added

Modified
dlib/dnn/core.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h
examples/CMakeLists.txt
Added
examples/dnn_inception_ex.cpp

Revision: 3710f9bf7d1b3224
Author: Davis King
Date: May 30, 2016 (03:35:25 UTC)

Cleaned up the contracts a little.

Modified
dlib/dnn/trainer_abstract.h

Revision: 01810065fb5a3a96
Author: Fm
Date: May 30, 2016 (12:25:23 UTC)

Added getter for trainer::train_one_step_calls

Modified
dlib/dnn/trainer.h
dlib/dnn/trainer_abstract.h

Revision: 014ef16a406d4985
Author: Davis King
Date: May 25, 2016 (15:12:36 UTC)

Made add_prev output a tensor with dimensions that are the max of each of the dimensions of its inputs rather than always outputting a tensor that has the dimensions of its immediate predecessors.

Modified
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h

Revision: 5c6dc31e052bfcbc
Author: Davis King
Date: May 23, 2016 (18:01:47 UTC)

updated example

Modified
examples/dnn_mnist_advanced_ex.cpp

Revision: 026791e9404a4608
Author: Davis King
Date: May 23, 2016 (18:01:37 UTC)

Added bias learning rate and weight decay multipliers to bn_ layers

Modified
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h
dlib/dnn/solvers.h

Revision: 02842d1ead9a1bd9
Author: Davis King
Date: May 23, 2016 (16:25:43 UTC)

Relaxed the requirements for calling find_min_box_constrained() and find_max_box_constrained(). Now the bounds can be empty for some variables.

Modified
dlib/optimization/optimization.h
dlib/optimization/optimization_abstract.h

Revision: 587ed2505faee4c2
Author: Davis King
Date: May 23, 2016 (15:57:53 UTC)

Changed code to avoid recreating thread_local cuda context objects.

Modified
dlib/dnn/trainer.h

Revision: 522937162ba182fb
Author: Davis King
Date: May 23, 2016 (02:54:55 UTC)

fixed broken tests

Modified
dlib/test/dnn.cpp

Revision: 4b0ba40bdee010ac
Author: Davis King
Date: May 22, 2016 (12:30:09 UTC)

Fixed a bug I introduced a minute ago.

Modified
dlib/dnn/core.h
dlib/dnn/core_abstract.h

Revision: 2d780c8ff054e5fa
Author: Davis King
Date: May 22, 2016 (12:14:10 UTC)

Fixed a bug in visit_layer_parameter_gradients() and visit_layer_parameters() caused by num_computational_layers being wrong when tax layers were placed as the first layer. These visit functions being wrong also caused multi-GPU support to not work on such networks.

Modified
dlib/dnn/core.h
dlib/test/dnn.cpp

Revision: a06033d239b68adf
Author: Davis King
Date: May 22, 2016 (11:49:40 UTC)

Changed the trainer threading code to use dlib::thread_pool instead of std::async() since std::async creates new threads with each invocation, which in turn causes objects with thread_local storage duration to be reconstructed each time. This is problematic because CUDA context objects for cublas and cudnn get reconstructed over and over, slowing things down and generally using more resources than should be used.

Modified
dlib/dnn/trainer.h

Revision: 635828e53bcfa8b5
Author: Davis King
Date: May 22, 2016 (09:17:10 UTC)

Cleaned up code a little and made the example use a better version of the architecture.

Modified
examples/dnn_mnist_advanced_ex.cpp

Revision: 516e7894b163d9af
Author: Davis King
Date: May 22, 2016 (06:30:15 UTC)

Fixing tests

Modified
dlib/test/dnn.cpp

Revision: 3d9334b28d23a9b2
Author: Davis King
Date: May 22, 2016 (06:26:23 UTC)

Made the batch normalization epsilon user settable rather than being hard coded.

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cpu_dlib.h
dlib/dnn/cudnn_dlibapi.cpp
dlib/dnn/cudnn_dlibapi.h
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h

Revision: 4e294c1002fb2c55
Author: Davis King
Date: May 22, 2016 (05:59:34 UTC)

Added learning rate and weight decay multipliers to the con_, fc_, and bn_ layers. Updated the solvers to support this.

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cpu_dlib.h
dlib/dnn/cuda_dlib.cu
dlib/dnn/cuda_dlib.h
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h
dlib/dnn/solvers.h
dlib/dnn/solvers_abstract.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h

Revision: bc894dae480c2f42
Author: Davis King
Date: May 21, 2016 (19:23:06 UTC)

Added more tests for the new affine_transform_range()

Modified
dlib/test/dnn.cpp

Revision: dc05bb90894d0679
Author: Davis King
Date: May 21, 2016 (19:22:26 UTC)

Added affine_transform_range() and another overload of affine_transform()

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cpu_dlib.h
dlib/dnn/cuda_dlib.cu
dlib/dnn/cuda_dlib.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h

Revision: b208f4f16b9c260d
Author: Davis King
Date: May 21, 2016 (19:16:49 UTC)

Added get_learning_rate_multiplier() and get_weight_decay_multiplier() global functions.

Modified
dlib/algs.h
dlib/dnn/core.h
dlib/dnn/core_abstract.h

Revision: 7b9b836fbf616591
Author: Davis King
Date: May 20, 2016 (04:29:39 UTC)

Added Johannes Huber's natvis file for visual studio.

Added
tools/visual_studio_natvis/README.txt
tools/visual_studio_natvis/dlib.natvis

Revision: 618761489d8a13f8
Author: Davis King
Date: May 18, 2016 (18:22:56 UTC)

Added an error message if a camera isn't available.

Modified
examples/webcam_face_pose_ex.cpp

Revision: 4e5df0eb8c401a7d
Author: Davis King
Date: May 15, 2016 (15:56:55 UTC)

Made LIB_INSTALL_DIR only appear when building dlib as an installable library, not when using dlib in another cmake project.

Modified
dlib/CMakeLists.txt

Revision: c3279168c3c34c99
Author: Davis King
Date: May 15, 2016 (12:28:44 UTC)

Now when you print a network to cout it will include the output tensor sizes for each layer if you have passed a tensor through the next.

Modified
dlib/dnn/core.h

Revision: d784ee76714119be
Author: Davis King
Date: May 15, 2016 (11:07:04 UTC)

Renamed compute_loss() to compute_loss_value_and_gradient() in the loss interface.

Modified
dlib/dnn/core.h
dlib/dnn/loss.h
dlib/dnn/loss_abstract.h

Revision: 39a1fc83d8d55527
Author: Davis King
Date: May 15, 2016 (10:52:33 UTC)

Added comment to show how to deserialize a network.

Modified
examples/dnn_mnist_ex.cpp

Revision: 0e27a08f87456e17
Author: Davis King
Date: May 15, 2016 (10:48:06 UTC)

Added a function to dnn_trainer that lets you query the "steps without progress" estimate. I also renamed the get/set functions for the shrink amount to have a consistent name and use the word "factor" instead of "amount".

Modified
dlib/dnn/trainer.h
dlib/dnn/trainer_abstract.h
examples/dnn_mnist_advanced_ex.cpp

Revision: 7444fe767025d77d
Author: Davis King
Date: May 15, 2016 (10:36:02 UTC)

Added set_learning_rate_schedule() to dnn_trainer.

Modified
dlib/dnn/trainer.h
dlib/dnn/trainer_abstract.h

Revision: 39d21efc90ccb750
Author: Davis King
Date: May 15, 2016 (10:31:06 UTC)

clarified comments.

Modified
examples/dnn_mnist_ex.cpp

Revision: 871c2767b46c95e1
Author: Davis King
Date: May 14, 2016 (16:30:45 UTC)

Changed the solver interface to take the learning rate and the layer details object as an input. This allows the solvers to exhibit a more complex behavior that depends on the specific layer. It also removes the learning rate from the solver's parameter set and pushes it entirely into the core training code. This also removes the need for the separate "step size" which previously was multiplied with the output of the solvers. Most of the code is still the same, and in the core and trainer the step_size variables have just been renamed to learning_rate. The dnn_trainer's relevant member functions have also been renamed. The examples have been updated to reflect these API changes. I also cleaned up the resnet definition and added better downsampling.

Modified
dlib/dnn/core.h
dlib/dnn/core_abstract.h
dlib/dnn/solvers.h
dlib/dnn/solvers_abstract.h
dlib/dnn/trainer.h
dlib/dnn/trainer_abstract.h
examples/dnn_mnist_advanced_ex.cpp
examples/dnn_mnist_ex.cpp

Revision: b8ca79904d4df660
Author: Davis King
Date: May 13, 2016 (05:01:24 UTC)

Made printing to cout or cerr check for matlab ctrl+c and throw an exception if so. This way, if you have a long running mex file it will be killable if it is periodically printing.

Modified
dlib/matlab/mex_wrapper.cpp

Revision: 13b81b51041983ed
Author: Davis King
Date: May 13, 2016 (19:08:03 UTC)

Fixed the in-place layers so that they don't interfere with the operation of skip layers and add_prev style layers. In particular, now in-place layers only overwrite the gradient information in their child layer if they are operating in in-place mode. Otherwise, they add their gradients to their child layers. It should also be noted that it's safe for in-place layers to overwrite gradients when in in-place mode since their child layers are inaccessible when in-place layers operate in in-place mode. This prevents any other layers from trying to add to the child layer, thereby avoiding the potability of layer interference. So the bug this change fixes is that, when not in in-place mode the child layers are still accessible but in-place layers were *still* overwriting child gradients.

Modified
dlib/dnn/core.h
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cpu_dlib.h
dlib/dnn/cuda_dlib.cu
dlib/dnn/cuda_dlib.h
dlib/dnn/cudnn_dlibapi.cpp
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h
dlib/test/dnn.cpp

Revision: 60eaa594e8f9ed9a
Author: Davis King
Date: May 13, 2016 (04:50:25 UTC)

Added intel architecture detection so SSE/AVX isn't enabled when it shouldn't be.

Modified
dlib/cmake

Revision: 618d4d0caeea942f
Author: Davis King
Date: May 13, 2016 (04:35:22 UTC)

Made dropout layer initialize its random number generator from std::rand() rather than always using the same seed.

Modified
dlib/dnn/layers.h

Revision: 0783d49a146c2dca
Author: Davis King
Date: May 13, 2016 (02:40:15 UTC)

Fixed a compiler error on some systems.

Modified
dlib/dnn/trainer.h

Revision: 40786b4dc5d40d45
Author: Davis King
Date: May 13, 2016 (02:32:18 UTC)

slightly relaxed tests to avoid false failure

Modified
dlib/test/cca.cpp

Revision: cc68d1ade3dc40ef
Author: Davis King
Date: May 12, 2016 (15:40:24 UTC)

I accidentally turned the max pooling layers into average pooling a few days ago. This fixes that and turns them back into max pooling layers.

Modified
dlib/dnn/layers.h

Revision: 6ff5d3ff3c55eea7
Author: Davis King
Date: May 12, 2016 (15:22:53 UTC)

Fixed network constructors so you can give an input layer for initialization without getting a compiler error.

Modified
dlib/dnn/core.h

Revision: 568c5b7a3c53ac37
Author: David Seifert
Date: May 10, 2016 (11:18:12 UTC)

* Add pkg-config file, allowing for build-system agnostic dependencies * Define LIB_INSTALL_DIR cache variable, allowing for multilib installations * Discover BLAS and LAPACK via pkg-config if possible * Fix incorrect toolchain variables in "dlib/test/makefile"

Modified
dlib/CMakeLists.txt
dlib/cmake_find_blas.txt
dlib/test/makefile
Added
dlib/dlib.pc.in

Revision: bb367dc2e9167075
Author: Davis King
Date: May 09, 2016 (17:46:04 UTC)

Fixed compiler warnings

Modified
dlib/dnn/layers.h

Revision: c3961540917e8ead
Author: Davis King
Date: May 07, 2016 (10:30:42 UTC)

Made example use the "everything" version of avg pooling.

Modified
examples/dnn_mnist_advanced_ex.cpp

Revision: 7cd9a0f83797aaa2
Author: Davis King
Date: May 07, 2016 (10:30:18 UTC)

Added max_pool_everything and avg_pool_everything.

Modified
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h

Revision: 372ff5b758a749b6
Author: Davis King
Date: May 07, 2016 (03:53:27 UTC)

Changed extract_fhog_features() back to returning matrix<double> since that's what it's contract says needs to happen (and what existing code expects).

Modified
dlib/image_transforms/fhog.h

Revision: f4220a92d0945ae6
Author: Davis King
Date: May 05, 2016 (02:58:52 UTC)

Made test error reporting more reliable

Modified
dlib/test/dnn.cpp

Revision: 50ac43e3dd2f8241
Author: Davis King
Date: May 04, 2016 (17:40:29 UTC)

Fixed avg pooling filter sizes to avoid errors with the new rules about non-one based strides.

Modified
examples/dnn_mnist_advanced_ex.cpp

Revision: eb8b88ef7fa28a51
Author: Davis King
Date: May 04, 2016 (17:39:31 UTC)

Improved error messages

Modified
dlib/dnn/cudnn_dlibapi.cpp

Revision: e9e47cb7c080c0d1
Author: Davis King
Date: May 04, 2016 (17:32:59 UTC)

Pushed the padding parameters into the con_, max_pool_, and avg_pool_ interfaces. Also changed the default behavior when the stride isn't 1. Now the filters will be applied only to the "valid" part of the image.

Modified
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h
dlib/test/dnn.cpp

Revision: 220cb636af22fc71
Author: Davis King
Date: May 04, 2016 (17:27:10 UTC)

Added missing ; to DLIB_TEST and DLIB_TEST_MSG macros now that they are required.

Modified
dlib/test/directed_graph.cpp
dlib/test/entropy_coder.cpp
dlib/test/image.cpp
dlib/test/is_same_object.cpp
dlib/test/matrix.cpp
dlib/test/matrix3.cpp
dlib/test/one_vs_all_trainer.cpp
dlib/test/one_vs_one_trainer.cpp
dlib/test/smart_pointers.cpp
dlib/test/vectorstream.cpp

Revision: 729ca298c8af56ba
Author: Davis King
Date: May 04, 2016 (17:13:28 UTC)

fixed typo in comment

Modified
dlib/dnn/tensor_tools.h

Revision: 90ea73cf501ccbf3
Author: Davis King
Date: May 03, 2016 (18:55:46 UTC)

Added a padding parameter to the pooling and convolution classes. Still need to expose it in the final layer interface.

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cpu_dlib.h
dlib/dnn/cudnn_dlibapi.cpp
dlib/dnn/cudnn_dlibapi.h
dlib/dnn/layers.h
dlib/dnn/tensor_tools.h
dlib/test/dnn.cpp

Revision: 83e6c2039931488d
Author: Davis King
Date: May 03, 2016 (17:44:39 UTC)

Made test less likely to false alarm.

Modified
dlib/test/dnn.cpp

Revision: 4f7582a53f71129e
Author: Davis King
Date: May 03, 2016 (16:36:09 UTC)

Improved macros

Modified
dlib/test/tester.h

Revision: fdbea5506e703c20
Author: Davis King
Date: May 02, 2016 (14:53:00 UTC)

fixed typo in spec

Modified
dlib/dnn/layers_abstract.h

Revision: c3b4a21758840cb5
Author: Davis King
Date: May 01, 2016 (02:56:34 UTC)

Made dlib work with libgif v5

Modified
dlib/image_loader/load_image.h

Revision: 954882c0e1988cf9
Author: Davis King
Date: Apr 30, 2016 (08:53:53 UTC)

Fixed bugs in multi-gpu training code.

Modified
dlib/dnn/trainer.h

Revision: 20cd0a18e869097d
Author: Davis King
Date: Apr 30, 2016 (08:28:00 UTC)

Added comments

Modified
dlib/dnn/tensor_tools.h

Revision: 887d57118bd8fd5e
Author: Davis King
Date: Apr 30, 2016 (07:09:50 UTC)

Added a num_device_groups() member function.

Modified
dlib/dnn/tensor_tools.h

Revision: 07892c7da7acd6cf
Author: Davis King
Date: Apr 30, 2016 (06:42:16 UTC)

Made launch_kernel() not generate CUDA errors if you ask it to launch a kernel of size 0.

Modified
dlib/dnn/cuda_utils.h

Revision: 421efd4210679302
Author: Davis King
Date: Apr 29, 2016 (05:53:05 UTC)

Added missing #include.

Modified
dlib/image_processing/shape_predictor.h

Revision: 65cf7575aafb4cbd
Author: Davis King
Date: Apr 29, 2016 (05:40:19 UTC)

Fixed namespace lookup problem due to a name clash.

Modified
dlib/bridge/bridge.h

Revision: d62d1a0d6ffeb2fe
Author: Davis King
Date: Apr 29, 2016 (04:04:54 UTC)

Fixed compiler warnings

Modified
dlib/dnn/cuda_dlib.h

Revision: 571005f4faf0882f
Author: Davis King
Date: Apr 29, 2016 (02:55:53 UTC)

Made multi-gpu mode use GPUDirect rather than copying through the CPU.

Modified
dlib/dnn/trainer.h

Revision: 6fe15da64792f203
Author: Davis King
Date: Apr 29, 2016 (02:55:04 UTC)

Made the multi_device_tensor_averager not assume the size of the tensors is known at set() time.

Modified
dlib/dnn/tensor_tools.h

Revision: 48a99971f1ea434c
Author: Davis King
Date: Apr 29, 2016 (02:54:30 UTC)

clarified spec

Modified
dlib/dnn/gpu_data_abstract.h
dlib/dnn/tensor_abstract.h

Revision: af950eda6373c303
Author: Davis King
Date: Apr 27, 2016 (17:50:31 UTC)

Added multi_device_tensor_averager

Modified
dlib/dnn/cuda_dlib.cu
dlib/dnn/cuda_dlib.h
dlib/dnn/tensor_tools.h

Revision: 382ca209c76c35ab
Author: Davis King
Date: Apr 28, 2016 (15:41:27 UTC)

clarified example

Modified
examples/dnn_mnist_advanced_ex.cpp

Revision: 4753e463b89f997b
Author: Davis King
Date: Apr 28, 2016 (14:57:15 UTC)

Fixed a bug in gaussian_blur() that caused messed up outputs when big sigma values were used on some pixel types.

Modified
dlib/image_transforms/spatial_filtering.h

Revision: 41c444435b2385a9
Author: Davis King
Date: Apr 27, 2016 (16:20:06 UTC)

Added more overloads of affine_transform()

Modified
dlib/dnn/cuda_dlib.cu
dlib/dnn/cuda_dlib.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h

Revision: c5214e7148b85015
Author: Davis King
Date: Apr 27, 2016 (16:18:57 UTC)

Added device_id() methods to gpu_data and tensor objects. These functions allow you to find out which device owns the memory inside these objects.

Modified
dlib/dnn/gpu_data.cpp
dlib/dnn/gpu_data.h
dlib/dnn/gpu_data_abstract.h
dlib/dnn/tensor.h
dlib/dnn/tensor_abstract.h

Revision: d977f0ca4678aeb6
Author: Davis King
Date: Apr 27, 2016 (08:36:50 UTC)

Made the cout and cerr redirection in mex files restore the state of the streambufs before exiting.

Modified
dlib/matlab/mex_wrapper.cpp

Revision: b71f11ff98266453
Author: Davis King
Date: Apr 26, 2016 (06:24:19 UTC)

Made the elastic_net inputs be in terms of trans(X)*X and trans(X)*Y rather than raw X and Y matrices.

Modified
dlib/optimization/elastic_net.h
dlib/optimization/elastic_net_abstract.h
dlib/test/elastic_net.cpp

Revision: 149bf8ce51ab635f
Author: Davis King
Date: Apr 26, 2016 (05:52:19 UTC)

made code faster

Modified
dlib/optimization/elastic_net.h

Revision: df16cfe84a9c8d84
Author: Davis King
Date: Apr 25, 2016 (13:05:10 UTC)

Added elastic_net solver.

Modified
dlib/test/CMakeLists.txt
Added
dlib/optimization/elastic_net.h
dlib/optimization/elastic_net_abstract.h
dlib/test/elastic_net.cpp

Revision: 82b56e9009ce9f58
Author: Davis King
Date: Apr 25, 2016 (12:34:14 UTC)

removed cruft

Modified
dlib/optimization/find_optimal_parameters.h

Revision: ea754bbf352d401d
Author: Davis King
Date: Apr 27, 2016 (04:49:02 UTC)

Fixed double counting of mini-batches for the purposes of solver termination when multiple GPUs are used.

Modified
dlib/dnn/trainer.h

Revision: d67d73abd4f07c93
Author: Davis King
Date: Apr 27, 2016 (04:48:23 UTC)

Fixed bad random number generation in layer initialization.

Modified
dlib/dnn/layers.h

Revision: 1289c4158a69a14e
Author: Davis King
Date: Apr 25, 2016 (04:26:29 UTC)

Added missing function

Modified
dlib/matrix/matrix.h

Revision: bc511d37a590fd3e
Author: Davis King
Date: Apr 25, 2016 (03:01:36 UTC)

fixed bug in tests

Modified
dlib/test/dnn.cpp

Revision: 96de7615a7de6fa9
Author: Davis King
Date: Apr 24, 2016 (06:08:55 UTC)

Added memcpy() functions for tensor and gpu_data objects.

Modified
dlib/dnn/gpu_data.cpp
dlib/dnn/gpu_data.h
dlib/dnn/gpu_data_abstract.h
dlib/dnn/tensor.h
dlib/dnn/tensor_abstract.h
dlib/test/dnn.cpp

Revision: dba3d6dfde580066
Author: Davis King
Date: Apr 24, 2016 (06:07:24 UTC)

Improved more macros

Modified
dlib/dnn/cublas_dlibapi.cpp
dlib/dnn/cudnn_dlibapi.cpp
dlib/dnn/curand_dlibapi.cpp

Revision: 36ec0f54919fda74
Author: Davis King
Date: Apr 24, 2016 (06:05:37 UTC)

Improved CHECK_CUDA() macro

Modified
dlib/dnn/cuda_utils.h

Revision: 2d3266a41aa46fb6
Author: Davis King
Date: Apr 24, 2016 (04:33:39 UTC)

fixed grammar in comment

Modified
dlib/dnn/tensor.h

Revision: fb67a0f047dfce1e
Author: Davis King
Date: Apr 21, 2016 (13:27:56 UTC)

Fixed an error where some assignments to matrix output variables would result in an exception getting thrown.

Modified
dlib/matlab/mex_wrapper.cpp

Revision: a3cf389a0072b72d
Author: Davis King
Date: Apr 20, 2016 (04:39:49 UTC)

Made the mex wrapper flush output streams to the matlab console when the mex function ends.

Modified
dlib/matlab/mex_wrapper.cpp

Revision: c09b25e5f529b5e6
Author: Davis King
Date: Apr 19, 2016 (17:57:59 UTC)

Fixed file I/O error that happens only on windows.

Modified
dlib/dnn/trainer.h

Revision: 503feb0d491f3a18
Author: Davis King
Date: Apr 19, 2016 (02:45:35 UTC)

Added visit_layer_parameter_gradients() and also fixed a silly synchronization error in the multi-gpu training code.

Modified
dlib/dnn/core.h
dlib/dnn/core_abstract.h
dlib/dnn/trainer.h

Revision: 963c45cf80a9f8f9
Author: Davis King
Date: Apr 19, 2016 (02:44:31 UTC)

Fixed typo in example

Modified
examples/dnn_mnist_advanced_ex.cpp

Revision: 1fbe04b3b9053871
Author: Davis King
Date: Apr 18, 2016 (18:48:07 UTC)

Added comments about using multiple GPUs

Modified
examples/dnn_mnist_advanced_ex.cpp

Revision: cf6bbb04b4e881da
Author: Davis King
Date: Apr 18, 2016 (18:03:02 UTC)

Added multi-gpu support to the dnn_trainer

Modified
dlib/dnn/trainer.h
dlib/dnn/trainer_abstract.h

Revision: d764426ce0679f89
Author: Davis King
Date: Apr 18, 2016 (18:02:42 UTC)

Added missing assert

Modified
dlib/dnn/cuda_dlib.h

Revision: 1e568527c996bcaf
Author: Davis King
Date: Apr 18, 2016 (14:11:38 UTC)

Added find_optimal_parameters()

Modified
dlib/test/CMakeLists.txt
Added
dlib/optimization/find_optimal_parameters.h
dlib/optimization/find_optimal_parameters_abstract.h
dlib/test/find_optimal_parameters.cpp

Revision: 1742063e07f8b432
Author: Davis King
Date: Apr 18, 2016 (14:11:16 UTC)

Fixed typo in error message

Modified
dlib/optimization/optimization_bobyqa.h

Revision: f6a281b9d2e007c8
Author: Davis King
Date: Apr 18, 2016 (14:04:00 UTC)

Added operator= that takes an initializer_list so that = assignments always behave in the way you would expect.

Modified
dlib/matrix/matrix.h
dlib/matrix/matrix_abstract.h

Revision: 15012d37a03bd5be
Author: Davis King
Date: Apr 18, 2016 (13:35:02 UTC)

Added a matrix constructor that takes an initializer list.

Modified
dlib/matrix/matrix.h
dlib/matrix/matrix_abstract.h

Revision: 729d47ae6f821e96
Author: Davis King
Date: Apr 17, 2016 (10:39:41 UTC)

Added visit_layer_parameters()

Modified
dlib/dnn/core.h
dlib/dnn/core_abstract.h

Revision: a3a8db1dbb4e78e2
Author: Davis King
Date: Apr 17, 2016 (10:35:40 UTC)

Clarified error message

Modified
dlib/dnn/trainer.h

Revision: d6fe2c4233115ef2
Author: Davis King
Date: Apr 17, 2016 (06:11:05 UTC)

Split the update() methods into two parts. One that computes gradients with respect to parameters and one that updates the parameters with those gradients.

Modified
dlib/dnn/core.h
dlib/dnn/core_abstract.h
dlib/dnn/trainer.h

Revision: 661d51740939813e
Author: Davis King
Date: Apr 17, 2016 (03:41:29 UTC)

fixed linker error

Modified
dlib/dnn/cuda_dlib.h

Revision: 76f63eb40a7ef8c1
Author: Davis King
Date: Apr 16, 2016 (18:43:17 UTC)

Made unit test less likely to false alarm.

Modified
dlib/test/dnn.cpp

Revision: db5185cfde94820c
Author: Davis King
Date: Apr 16, 2016 (17:12:31 UTC)

Added get_num_devices()

Modified
dlib/dnn/cuda_dlib.cu
dlib/dnn/cuda_dlib.h

Revision: b7675e870b977dc9
Author: Davis King
Date: Apr 16, 2016 (06:50:15 UTC)

- Renamed network_type::num_layers to network_type::num_computational_layers. - Made layer() recurse into repeat objects so that the index given to layer() does what you would expect. - Added an operator<< for network objects that prints the network architecture.

Modified
dlib/dnn/core.h
dlib/dnn/core_abstract.h
dlib/dnn/input.h
dlib/dnn/input_abstract.h
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h
dlib/dnn/loss.h
dlib/dnn/loss_abstract.h
dlib/dnn/trainer.h
dlib/dnn/trainer_abstract.h
dlib/test/dnn.cpp
examples/dnn_mnist_advanced_ex.cpp

Revision: 0ffad5712a6341e3
Author: Davis King
Date: Apr 16, 2016 (02:36:59 UTC)

fixed typo

Modified
dlib/dnn/layers_abstract.h

Revision: cb3d86acba215761
Author: Davis King
Date: Apr 16, 2016 (02:36:07 UTC)

renamed EXAMPLE_LAYER_ to EXAMPLE_COMPUTATIONAL_LAYER_

Modified
dlib/dnn/core_abstract.h
dlib/dnn/layers_abstract.h

Revision: 3363f5e21ae3dc70
Author: Davis King
Date: Apr 16, 2016 (02:22:43 UTC)

Added a few more tests

Modified
dlib/test/dnn.cpp

Revision: fbc638691df94bd3
Author: Davis King
Date: Apr 14, 2016 (17:48:59 UTC)

fixed grammar in some comments

Modified
dlib/dnn/core.h

Revision: 058103555a26432d
Author: Davis King
Date: Apr 12, 2016 (05:20:09 UTC)

Fixed compiler errors when using std::vector in mex wrapper.

Modified
dlib/matlab/mex_wrapper.cpp

Revision: b13636e9fb635092
Author: Davis King
Date: Apr 11, 2016 (19:11:18 UTC)

Seeded random number generator with the clock since that's generally a good thing to do for this kind of training.

Modified
examples/dnn_mnist_advanced_ex.cpp

Revision: 70ec47c3a91f216e
Author: Davis King
Date: Apr 11, 2016 (19:06:32 UTC)

fixed formatting

Modified
examples/dnn_mnist_advanced_ex.cpp

Revision: 838bbeb2fefe9f9d
Author: Davis King
Date: Apr 11, 2016 (18:58:54 UTC)

Clarified spec and cleaned up code slightly

Modified
dlib/dnn/trainer.h
dlib/dnn/trainer_abstract.h

Revision: 4971ae6ba72b7f63
Author: Davis King
Date: Apr 11, 2016 (18:57:11 UTC)

renamed a file

Modified
examples/CMakeLists.txt
Added
examples/dnn_mnist_advanced_ex.cpp
Deleted
examples/dnn_mnist_resnet_ex.cpp

Revision: d76ef2221d82a087
Author: Davis King
Date: Apr 11, 2016 (18:55:49 UTC)

Fleshed out these examples more.

Modified
examples/dnn_mnist_ex.cpp
examples/dnn_mnist_resnet_ex.cpp

Revision: 6a2c295f6960714f
Author: Davis King
Date: Apr 11, 2016 (17:18:14 UTC)

Fixed grammar and clarified a few things.

Modified
examples/dnn_mnist_ex.cpp

Revision: 1e48056383c33fff
Author: Davis King
Date: Apr 11, 2016 (05:00:44 UTC)

fixed an array indexing error.

Modified
dlib/image_transforms/fhog.h

Revision: d20a7098b28a858b
Author: Fm
Date: Apr 11, 2016 (14:08:52 UTC)

Removed simd4 and ifdef's

Modified
dlib/image_transforms/fhog.h

Revision: c9202e075e3bf2cb
Author: Fm
Date: Apr 05, 2016 (15:43:54 UTC)

Added simd8 usage on FHOG features computation

Modified
dlib/image_transforms/fhog.h

Revision: 45462f7305fca342
Author: Davis King
Date: Apr 10, 2016 (13:30:45 UTC)

Added a narrative to this example.

Modified
examples/dnn_mnist_ex.cpp

Revision: 549c04de7c7ef1a4
Author: Davis King
Date: Apr 10, 2016 (13:30:07 UTC)

Fixed errors in documentation

Modified
dlib/dnn/loss_abstract.h
dlib/dnn/trainer_abstract.h

Revision: 31a238732c92571b
Author: Davis King
Date: Apr 10, 2016 (09:41:05 UTC)

Minor code cleanup

Modified
dlib/dnn/trainer.h

Revision: 43df14dd5b8fcd4f
Author: Davis King
Date: Apr 10, 2016 (08:11:19 UTC)

Made examples work with new fc<> template.

Modified
examples/dnn_mnist_ex.cpp
examples/dnn_mnist_resnet_ex.cpp

Revision: c184315f61a7a774
Author: Davis King
Date: Apr 10, 2016 (08:10:56 UTC)

Made fc<> always use a bias and added an fc_no_bias<> for the other case.

Modified
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h
dlib/test/dnn.cpp

Revision: c8a5e67104ad42bf
Author: Davis King
Date: Apr 10, 2016 (07:31:24 UTC)

Just renamed variables to reflect the new meaning of the batch normalization running variance output.

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cpu_dlib.h
dlib/dnn/cudnn_dlibapi.cpp
dlib/dnn/cudnn_dlibapi.h
dlib/dnn/layers.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h
dlib/test/dnn.cpp

Revision: f980a565be7ec565
Author: Davis King
Date: Apr 10, 2016 (06:54:49 UTC)

merged

Modified
dlib/dnn/test_for_cuda/CMakeLists.txt
dlib/dnn/test_for_cuda/cuda_test.cu

Revision: 5592e8a9218fff5a
Author: Davis King
Date: Apr 10, 2016 (06:52:40 UTC)

upgraded to cudnn v5. Also changed the affine_ layer to not be templated but to automatically select the right mode. The serialization format for bn_ layers has also changed, but the code will still be able to deserialize older bn_ objects.

Modified
dlib/CMakeLists.txt
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cpu_dlib.h
dlib/dnn/cudnn_dlibapi.cpp
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h
dlib/dnn/tensor_tools.h
dlib/dnn/test_for_cuda/CMakeLists.txt
dlib/dnn/test_for_cudnn/CMakeLists.txt
dlib/test/dnn.cpp
examples/dnn_mnist_resnet_ex.cpp

Revision: 80bc833972968417
Author: Davis King
Date: Apr 09, 2016 (19:10:27 UTC)

Made the cuda test include some header files to make it a little more realistic.

Modified
dlib/dnn/test_for_cuda/CMakeLists.txt
dlib/dnn/test_for_cuda/cuda_test.cu

Revision: 119cca87d019254a
Author: Davis King
Date: Apr 09, 2016 (15:54:59 UTC)

Made unit test more robust

Modified
dlib/test/correlation_tracker.cpp

Revision: b852c4344d28736a
Author: Davis King
Date: Apr 09, 2016 (08:53:12 UTC)

Minor changes to avoid warnings and a bug in clang.

Modified
dlib/smart_pointers/shared_ptr.h
dlib/test/matrix3.cpp
dlib/test/smart_pointers.cpp

Revision: d07b8b3b67fc34d5
Author: Davis King
Date: Apr 09, 2016 (06:07:33 UTC)

Made tests more robust.

Modified
dlib/test/opt_qp_solver.cpp

Revision: 2cfc68c63c7f230f
Author: Davis King
Date: Apr 09, 2016 (05:21:17 UTC)

Fixed c++11 test program.

Modified
dlib/dnn/test_for_cpp11/cpp11_test.cpp

Revision: d7a29a9ee229f7ea
Author: Davis King
Date: Apr 09, 2016 (05:17:55 UTC)

Adjusted test threshold to avoid false test failure.

Modified
dlib/test/opt_qp_solver.cpp

Revision: 1d701541cd4c1220
Author: Davis King
Date: Apr 09, 2016 (05:16:57 UTC)

Improved C++11 detection.

Modified
dlib/dnn/test_for_cpp11/cpp11_test.cpp
dlib/use_cpp_11.cmake

Revision: 9cc6e176410847d1
Author: Davis King
Date: Apr 08, 2016 (19:13:48 UTC)

merged

Modified
dlib/image_processing/correlation_tracker.h
dlib/image_processing/correlation_tracker_abstract.h
dlib/test/CMakeLists.txt
Added
dlib/test/correlation_tracker.cpp
Deleted
dlib/test/corellation_tracker.cpp

Revision: 0960546668b7c82a
Author: Davis King
Date: Apr 08, 2016 (19:12:53 UTC)

Moved most of the layer parameters from runtime variables set in constructors to template arguments. This way, the type of a network specifies the entire network architecture and most of the time the user doesn't even need to do anything with layer constructors.

Modified
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h
dlib/test/dnn.cpp
examples/dnn_mnist_ex.cpp
examples/dnn_mnist_resnet_ex.cpp

Revision: 4d0e1f7574db73a0
Author: Davis King
Date: Apr 08, 2016 (18:37:28 UTC)

Improved the add_layer forwarding constructor. Also added repeat_group() variable decorator.

Modified
dlib/dnn/core.h
dlib/dnn/core_abstract.h

Revision: ac33bbf6978f92ec
Author: Davis King
Date: Apr 08, 2016 (15:59:32 UTC)

Added global functions for telling cuDNN to prefer fast or memory efficient algorithms.

Modified
dlib/dnn/core_abstract.h
dlib/dnn/cudnn_dlibapi.cpp
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h

Revision: 503bd7f8ba23d7c8
Author: Davis King
Date: Apr 08, 2016 (13:31:49 UTC)

fixed spelling error

Modified
dlib/test/CMakeLists.txt
Added
dlib/test/correlation_tracker.cpp
Deleted
dlib/test/corellation_tracker.cpp

Revision: 72a669118ee44279
Author: Fm
Date: Apr 08, 2016 (12:43:16 UTC)

Fixed corellation_tracker abstract docs

Modified
dlib/image_processing/correlation_tracker_abstract.h

Revision: 977b5387746a98bf
Author: Fm
Date: Apr 08, 2016 (12:39:15 UTC)

Changed corellation_tracker constructor

Modified
dlib/image_processing/correlation_tracker.h
dlib/image_processing/correlation_tracker_abstract.h

Revision: 701bb64050da859f
Author: Fm
Date: Apr 07, 2016 (21:54:07 UTC)

Added options for corellation tracker

Modified
dlib/image_processing/correlation_tracker.h

Revision: 310a0c43376990eb
Author: Fm
Date: Apr 07, 2016 (21:34:47 UTC)

Added options for corellation tracker

Modified
dlib/image_processing/correlation_tracker.h
dlib/image_processing/correlation_tracker_abstract.h

Revision: ff1b1d10ea8bc2ad
Author: Davis King
Date: Apr 08, 2016 (05:38:23 UTC)

Fixed bug in mex binding API.

Modified
dlib/matrix/matrix_data_layout.h

Revision: 5d01895f78be3ed8
Author: Davis King
Date: Apr 08, 2016 (04:59:06 UTC)

Minor change to avoid compiler warnings.

Modified
dlib/dnn/core.h

Revision: 0c2ff939b446c4be
Author: Davis King
Date: Apr 08, 2016 (03:18:15 UTC)

Fixed another compiler error that could happen with the forwarding constructor.

Modified
dlib/dnn/core.h

Revision: 769ccd8195b03bd7
Author: Davis King
Date: Apr 08, 2016 (02:41:16 UTC)

merged

Modified
dlib/image_transforms/fhog.h
dlib/simd/simd_check.h
dlib/test/CMakeLists.txt
Added
dlib/test/corellation_tracker.cpp

Revision: 199e769f8fe63728
Author: Fm
Date: Apr 07, 2016 (16:08:38 UTC)

Added regression test for corellation_tracker

Modified
dlib/test/corellation_tracker.cpp

Revision: b3665ca7fbf6de36
Author: Evgeniy Fominov
Date: Apr 07, 2016 (15:26:37 UTC)

Added regression test for corellation_tracker

Modified
dlib/test/CMakeLists.txt
Added
dlib/test/corellation_tracker.cpp

Revision: 4adfd448cc3121ba
Author: Evgeniy Fominov
Date: Apr 04, 2016 (22:57:46 UTC)

Changed fhog calculations from double to float

Modified
dlib/image_transforms/fhog.h

Revision: ccfd1177c903f8aa
Author: Fm
Date: Apr 04, 2016 (22:17:45 UTC)

Changed fhog calculations from double to float

Modified
dlib/image_transforms/fhog.h

Revision: d15692db0c1adead
Author: Fm
Date: Apr 01, 2016 (17:48:20 UTC)

MSVC SSE2 automatical support for x64

Modified
dlib/simd/simd_check.h

Revision: 5d4f7e09653e0f81
Author: Fm
Date: Apr 01, 2016 (17:46:44 UTC)

MSVC SSE2 automatical support for x64

Modified
dlib/simd/simd_check.h

Revision: e31145a495911911
Author: Davis King
Date: Apr 07, 2016 (19:16:17 UTC)

Fixed compile time bug in the constructor I just added.

Modified
dlib/dnn/core.h

Revision: a95dc910b9d3628f
Author: Davis King
Date: Apr 07, 2016 (18:55:17 UTC)

Made it so you can skip giving layer detail objects to a network's constructor if they should be default constructed.

Modified
dlib/dnn/core.h
dlib/dnn/core_abstract.h

Revision: 8dbd9509bfc600be
Author: Davis King
Date: Apr 07, 2016 (17:20:36 UTC)

clarified spec

Modified
dlib/dnn/trainer_abstract.h

Revision: 667fcf84576338de
Author: Davis King
Date: Apr 07, 2016 (09:01:37 UTC)

Fixed a bug that caused the matrix to throw an error during some assignment statements when used inside a matlab mex file.

Modified
dlib/matrix/matrix.h
dlib/matrix/matrix_data_layout.h

Revision: 0422b08dd4f2bf28
Author: Davis King
Date: Apr 01, 2016 (07:38:16 UTC)

Added a member function to get the line intercept from running_gradient.

Modified
dlib/statistics/running_gradient.h
dlib/statistics/running_gradient_abstract.h

Revision: cfaf4587b960a2ef
Author: Davis King
Date: Apr 02, 2016 (05:34:01 UTC)

Added input_rgb_image.

Modified
dlib/dnn/input.h
dlib/dnn/input_abstract.h

Revision: 2beff8e5240b5e48
Author: Davis King
Date: Mar 31, 2016 (17:11:11 UTC)

minor cleanup

Modified
dlib/dnn/layers.h

Revision: 79eb055fc06c3af4
Author: Davis King
Date: Mar 31, 2016 (17:10:56 UTC)

Added unit test for prelu layer.

Modified
dlib/test/dnn.cpp

Revision: f2332635c46ae093
Author: Davis King
Date: Mar 31, 2016 (17:07:04 UTC)

Added prelu layer

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cpu_dlib.h
dlib/dnn/cuda_dlib.cu
dlib/dnn/cuda_dlib.h
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h

Revision: 7b66399d2e76249b
Author: Davis King
Date: Mar 31, 2016 (16:58:34 UTC)

Fixed a bug in affine_. The layer was implemented as an inplace layer, however, that doesn't really work if we need to compute the gradients with respect to the parameters which the layer attempted to do. So I made the layer's parameters non-learnable so it can continue to be inplace since the main usecase for this layer is to be a fast replacement for bn_ during testing.

Modified
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h

Revision: 1c5fb0b70e835b1f
Author: Evgeniy Fominov
Date: Mar 30, 2016 (13:37:03 UTC)

Python/Simple object detector trainer. Added upsample_limit option

Modified
tools/python/src/object_detection.cpp
tools/python/src/simple_object_detector.h

Revision: 734f0fb4bb347d06
Author: Davis King
Date: Mar 29, 2016 (06:26:55 UTC)

Yet more stability improvements for line_search().

Modified
dlib/optimization/optimization_line_search.h

Revision: dcc86b773ec3efb5
Author: Davis King
Date: Mar 29, 2016 (05:31:40 UTC)

More robustness improvements to line_search(). Mostly just parameter tweaks.

Modified
dlib/optimization/optimization_line_search.h

Revision: 8ee3c300c0a677c6
Author: Davis King
Date: Mar 28, 2016 (11:43:11 UTC)

Improved line_search() behavior for functions without continuous derivatives. Also made the bracketing phase more efficient.

Modified
dlib/optimization/optimization_line_search.h
dlib/optimization/optimization_line_search_abstract.h

Revision: b011a9ee773c6a55
Author: Davis King
Date: Mar 28, 2016 (07:36:34 UTC)

fixed spelling error in comment

Modified
dlib/optimization/optimization.h

Revision: aacce10e14dc4b4c
Author: Davis King
Date: Mar 27, 2016 (13:22:25 UTC)

Renamed variable to make things more clear.

Modified
dlib/dnn/core.h
dlib/dnn/core_abstract.h

Revision: 7abdbdceb61e6ab5
Author: Davis King
Date: Mar 27, 2016 (06:50:52 UTC)

A bit more cleanup

Modified
examples/dnn_mnist_resnet_ex.cpp

Revision: ee1fbe1c32859c40
Author: Davis King
Date: Mar 27, 2016 (06:29:30 UTC)

added more stuff to example

Modified
examples/dnn_mnist_resnet_ex.cpp

Revision: 98eb7ba76bbb11fa
Author: Davis King
Date: Mar 27, 2016 (04:45:44 UTC)

Minor change to avoid compiler warning

Modified
dlib/dnn/core.h

Revision: ff695ad1b6cf1d71
Author: Davis King
Date: Mar 26, 2016 (19:16:43 UTC)

Changed this example to be another mnist example so it runs in a non-insane amount of time.

Modified
examples/CMakeLists.txt
Added
examples/dnn_mnist_resnet_ex.cpp
Deleted
examples/dnn_mit67_ex.cpp

Revision: ca40de922d2182cb
Author: Davis King
Date: Mar 26, 2016 (19:07:38 UTC)

Removed cruft

Modified
examples/dnn_mnist_ex.cpp

Revision: 4c06a892e8125440
Author: Davis King
Date: Mar 26, 2016 (18:58:57 UTC)

Added ADAM tests

Modified
dlib/test/dnn.cpp

Revision: 905123f0f0cff88f
Author: Davis King
Date: Mar 26, 2016 (18:58:39 UTC)

Added ADAM solver.

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cpu_dlib.h
dlib/dnn/cuda_dlib.cu
dlib/dnn/cuda_dlib.h
dlib/dnn/solvers.h
dlib/dnn/solvers_abstract.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h

Revision: b8b33f71d134d07e
Author: Davis King
Date: Mar 26, 2016 (18:29:21 UTC)

Fixed bug in add_tag_layer that prevented it from working when placed immediately after the input layer.

Modified
dlib/dnn/core.h

Revision: 6a6085ece3bca92f
Author: Davis King
Date: Mar 26, 2016 (08:21:40 UTC)

Merged and also updated documentation to reflect these changes.

Modified
dlib/image_transforms/fhog.h
dlib/image_transforms/fhog_abstract.h

Revision: 19ac649297a5c7fa
Author: ray glover
Date: Mar 26, 2016 (11:49:34 UTC)

introduce a configurable threshold for rendering HOGs

Modified
dlib/image_transforms/fhog.h

Revision: bf5897181e4f071f
Author: Davis King
Date: Mar 25, 2016 (05:01:48 UTC)

Cleaned up trainer API and made the verbose output include information about how much the current step size has converged.

Modified
dlib/dnn/trainer.h
dlib/dnn/trainer_abstract.h

Revision: 796b0a395f829f24
Author: Davis King
Date: Mar 25, 2016 (04:32:30 UTC)

Added count_steps_without_decrease() and count_steps_without_increase().

Modified
dlib/statistics/running_gradient.h
dlib/statistics/running_gradient_abstract.h

Revision: 890c5c1966662914
Author: Davis King
Date: Mar 20, 2016 (15:28:57 UTC)

Adding clarifications to spec which were pointed out by Scott Richardson.

Modified
dlib/dnn/core_abstract.h
dlib/dnn/layers_abstract.h
dlib/dnn/tensor_abstract.h

Revision: 566ac5667b01ad4c
Author: Davis King
Date: Mar 18, 2016 (06:45:14 UTC)

Added apply_random_color_offset()

Modified
dlib/image_transforms/random_color_transform.h
dlib/image_transforms/random_color_transform_abstract.h

Revision: b66abed2e31c836f
Author: Davis King
Date: Mar 18, 2016 (06:44:52 UTC)

Added a constructor for seeding rand with a time_t.

Modified
dlib/rand/rand_kernel_1.h
dlib/rand/rand_kernel_abstract.h

Revision: 5f508c6622d2e3f5
Author: Davis King
Date: Mar 11, 2016 (10:34:39 UTC)

fixed cout and cerr in mex wrapper

Modified
dlib/matlab/mex_wrapper.cpp

Revision: ad6f383b3ad7b004
Author: Davis King
Date: Mar 11, 2016 (05:27:39 UTC)

Made cerr print in matlab as a red warning message.

Modified
dlib/matlab/mex_wrapper.cpp

Revision: 9448e717ce7e3a80
Author: Davis King
Date: Mar 11, 2016 (03:59:06 UTC)

Renamed check_for_ctrl_c() to check_for_matlab_ctrl_c(), put everything in call_matlab.h into dlib namespace, and also added missing overloads for call_matlab().

Modified
dlib/matlab/call_matlab.h
dlib/matlab/mex_wrapper.cpp

Revision: c83a0257963dfa10
Author: Davis King
Date: Mar 08, 2016 (10:22:40 UTC)

Updated comment

Modified
dlib/matlab/example_mex_function.cpp

Revision: 8226c88018dac504
Author: Davis King
Date: Mar 08, 2016 (10:19:43 UTC)

merged

Modified
dlib/CMakeLists.txt
dlib/optimization/optimization_solve_qp_using_smo.h
dlib/optimization/optimization_solve_qp_using_smo_abstract.h
dlib/test/mpc.cpp
docs/docs/optimization.xml
docs/docs/term_index.xml
Added
CMakeLists.txt

Revision: e3146feb788ef032
Author: Davis King
Date: Mar 08, 2016 (10:18:48 UTC)

Upgraded mex wrapper to support 20 argument functions instead of just 10.

Modified
dlib/any/any_function.h
dlib/matlab/mex_wrapper.cpp

Revision: 30dae5076d09fc81
Author: Davis King
Date: Mar 08, 2016 (10:18:19 UTC)

Made DLIB_ASSERT and DLIB_CASSERT not kill the process when running inside a MATLAB mex file.

Modified
dlib/error.h

Revision: 0c80a97e1aef7747
Author: Davis King
Date: Mar 06, 2016 (06:52:50 UTC)

merged

Modified
dlib/CMakeLists.txt
dlib/dnn/test_for_cudnn/CMakeLists.txt
dlib/dnn/test_for_cudnn/find_cudnn.txt

Revision: ada15024acf4db14
Author: Davis King
Date: Mar 06, 2016 (06:40:44 UTC)

Changed the cmake scripts to forward CMAKE_PREFIX_PATH to the try_compile statements rather than a cuDNN specific variable.

Modified
dlib/CMakeLists.txt
dlib/dnn/test_for_cudnn/find_cudnn.txt

Revision: 970f40db2f509772
Author: Daniel Crispell
Date: Mar 04, 2016 (11:54:00 UTC)

allow user to interactively set CUDNN paths

Modified
dlib/CMakeLists.txt

Revision: 24f64fb03be60501
Author: Daniel Crispell
Date: Mar 04, 2016 (05:01:51 UTC)

standardize cmake and env CUDNN variable names

Modified
dlib/CMakeLists.txt
dlib/dnn/test_for_cudnn/find_cudnn.txt

Revision: f78694b91e4e3419
Author: Daniel Crispell
Date: Mar 03, 2016 (13:16:17 UTC)

Check CUDNN environment variables for path

Modified
dlib/dnn/test_for_cudnn/find_cudnn.txt

Revision: 23ebf035fbcabaf5
Author: Daniel Crispell
Date: Mar 03, 2016 (13:15:21 UTC)

Don't include cudnn_include_path until we find it.

Modified
dlib/dnn/test_for_cudnn/CMakeLists.txt

Revision: 7e45a31a9ae8a226
Author: Daniel Crispell
Date: Feb 29, 2016 (12:41:51 UTC)

try_compile needs cudnn cmake vars explicitly passed

Modified
dlib/CMakeLists.txt

Revision: d493a93147c50a43
Author: Davis King
Date: Feb 29, 2016 (16:15:03 UTC)

merged

Modified
dlib/CMakeLists.txt
dlib/data_io/image_dataset_metadata.cpp
dlib/data_io/image_dataset_metadata.h
dlib/geometry/rectangle.h
dlib/geometry/rectangle_abstract.h
docs/docs/faq.xml
docs/docs/optimization.xml
Added
CMakeLists.txt

Revision: c2a07a67cae6a08c
Author: Davis King
Date: Feb 27, 2016 (04:23:18 UTC)

changed to run on image net

Modified
examples/dnn_mit67_ex.cpp

Revision: f3d21437bb93dadf
Author: Davis King
Date: Feb 27, 2016 (04:21:39 UTC)

Fixed spelling error in method name. Also optimized and cleaned up the automatic step size reduction code a little.

Modified
dlib/dnn/trainer.h
dlib/dnn/trainer_abstract.h

Revision: 13402155490c31bd
Author: Davis King
Date: Feb 22, 2016 (12:13:27 UTC)

merged

Modified
dlib/cmake_find_blas.txt
dlib/matrix/matrix_assign_fwd.h
dlib/matrix/matrix_data_layout.h
dlib/optimization/optimization_oca.h
dlib/optimization/optimization_oca_abstract.h
dlib/optimization/optimization_solve_qp_using_smo.h
dlib/optimization/optimization_solve_qp_using_smo_abstract.h
dlib/server/server_iostream.h
dlib/smart_pointers/shared_ptr.h
dlib/smart_pointers/shared_ptr_thread_safe.h
dlib/test/least_squares.cpp
dlib/test/oca.cpp
dlib/test/opt_qp_solver.cpp
dlib/test/smart_pointers.cpp
dlib/threads/threads_kernel_shared.h
docs/docs/optimization.xml

Revision: 5026d5c0625a7bb5
Author: Davis King
Date: Feb 18, 2016 (05:22:19 UTC)

merged

Modified
dlib/svm/svm_c_linear_dcd_trainer.h
dlib/svm/svm_c_linear_dcd_trainer_abstract.h

Revision: 44ba91e8c5a94968
Author: Davis King
Date: Feb 18, 2016 (05:14:52 UTC)

merged

Modified
dlib/svm/svm_c_linear_dcd_trainer.h

Revision: 133071cfea2f5b1c
Author: Davis King
Date: Feb 18, 2016 (05:14:06 UTC)

merged

Modified
dlib/svm/svm_c_linear_dcd_trainer.h
dlib/svm/svm_c_linear_dcd_trainer_abstract.h
dlib/test/svm_c_linear_dcd.cpp

Revision: e0d4c4ba7c04f194
Author: Davis King
Date: Feb 17, 2016 (06:08:23 UTC)

merged

Modified
dlib/svm/svm_c_linear_dcd_trainer.h
dlib/svm/svm_c_linear_dcd_trainer_abstract.h
dlib/test/svm_c_linear_dcd.cpp

Revision: df11a21c95048aaa
Author: Davis King
Date: Feb 16, 2016 (12:34:16 UTC)

Fixed spelling error in comment.

Modified
dlib/svm/svm_c_linear_dcd_trainer.h

Revision: 635a8fd1c758542b
Author: Davis King
Date: Feb 13, 2016 (03:31:12 UTC)

Updated dlib to work with the released cuDNN V4.0 and also updated the cmake scripts so they attempt to verify the version of cuDNN you have installed and print a useful message if that isn't the case.

Modified
dlib/CMakeLists.txt
dlib/dnn/cudnn_dlibapi.cpp
Added
dlib/dnn/test_for_cudnn/CMakeLists.txt
dlib/dnn/test_for_cudnn/find_cudnn.txt

Revision: 5586d7c274ad4e2a
Author: Davis King
Date: Feb 13, 2016 (00:26:56 UTC)

Made imglab look for gif files when scanning folders for images.

Modified
tools/imglab/src/main.cpp

Revision: 9633fc90038fe1c5
Author: Davis King
Date: Feb 11, 2016 (06:19:17 UTC)

Added asserts to catch a common user error.

Modified
dlib/matrix/matrix.h
dlib/matrix/matrix_abstract.h

Revision: a553d5f7991e6fa4
Author: Davis King
Date: Feb 11, 2016 (04:00:15 UTC)

Made check_for_ctrl_c() available outside matlab build system.

Modified
dlib/matlab/call_matlab.h

Revision: 0489dc8ec6cf50a2
Author: Davis King
Date: Feb 10, 2016 (07:13:32 UTC)

Made copying to matlab a little bit faster.

Modified
dlib/matlab/mex_wrapper.cpp

Revision: 8ba3d8fd59a64b80
Author: Davis King
Date: Feb 10, 2016 (06:35:53 UTC)

Fixed bug in 10 argument version of call_matlab() and also cleaned up a few minor things.

Modified
dlib/matlab/call_matlab.h
dlib/matlab/mex_wrapper.cpp
dlib/matrix/matrix_data_layout.h

Revision: 99c443d2273f4eb0
Author: Davis King
Date: Feb 09, 2016 (04:06:03 UTC)

clarified spec

Modified
dlib/dnn/loss_abstract.h

Revision: 5245eebad57216f0
Author: Davis King
Date: Feb 08, 2016 (09:02:27 UTC)

Removed unused variable

Modified
dlib/dnn/loss.h

Revision: 7f25538343058215
Author: Davis King
Date: Feb 08, 2016 (04:19:01 UTC)

Made the dnn_trainer check for convergence every iteration rather than only once every few thousand iterations.

Modified
dlib/dnn/trainer.h

Revision: 39b167a27518d384
Author: Davis King
Date: Feb 08, 2016 (04:13:02 UTC)

Removed gif filtering

Modified
examples/dnn_mit67_ex.cpp

Revision: f6a7aa3f132d9282
Author: Davis King
Date: Feb 08, 2016 (04:10:28 UTC)

Made the gif reader work on interlaced images.

Modified
dlib/image_loader/load_image.h

Revision: 2a21948ef05ccc1a
Author: Davis King
Date: Feb 08, 2016 (03:52:12 UTC)

Fixed GIF reader so it works on a wider variety of GIF files.

Modified
dlib/image_loader/load_image.h

Revision: cd52dc4c54cf01ad
Author: Davis King
Date: Feb 07, 2016 (15:59:55 UTC)

Made load_image() support GIF files.

Modified
dlib/CMakeLists.txt
dlib/config.h
dlib/config.h.in
dlib/image_loader/load_image.h
dlib/image_loader/load_image_abstract.h

Revision: 58e6b148279cb1d9
Author: Davis King
Date: Feb 06, 2016 (17:39:43 UTC)

Added some dnn examples.

Modified
examples/CMakeLists.txt
Added
examples/dnn_mit67_ex.cpp
examples/dnn_mnist_ex.cpp

Revision: 0366b94fec1e54cd
Author: Davis King
Date: Feb 05, 2016 (10:53:52 UTC)

merged

Modified
dlib/CMakeLists.txt
dlib/geometry/drectangle.h
dlib/geometry/drectangle_abstract.h
dlib/smart_pointers/shared_ptr.h
dlib/smart_pointers/shared_ptr_thread_safe.h
tools/python/CMakeLists.txt
tools/python/src/dlib.cpp
tools/python/src/rectangles.cpp
tools/python/src/shape_predictor.cpp
tools/python/src/shape_predictor.h

Revision: 1487dd70bea3a420
Author: Davis King
Date: Feb 05, 2016 (10:43:09 UTC)

Minor change to avoid compiler errors in older compilers

Modified
dlib/data_io/mnist.cpp

Revision: ead2f534487bdf3b
Author: Davis King
Date: Feb 05, 2016 (08:42:09 UTC)

Updated documentation

Modified
dlib/matlab/example_mex_function.cpp

Revision: 2b522636c72ca81e
Author: Davis King
Date: Feb 05, 2016 (07:50:02 UTC)

Fixed compile time error.

Modified
dlib/matlab/mex_wrapper.cpp

Revision: 73e14b7fc7b466ab
Author: Davis King
Date: Feb 05, 2016 (07:31:59 UTC)

Made column major matrices directly wrap matlab matrix objects when used inside mex files. This way, if you use matrix_colmajor or fmatrix_colmajor in a mex file it will not do any unnecessary copying or transposing.

Modified
dlib/matlab/mex_wrapper.cpp
dlib/matrix/matrix.h
dlib/matrix/matrix_abstract.h
dlib/matrix/matrix_data_layout.h

Revision: 5349d54aad806f4c
Author: Davis King
Date: Feb 05, 2016 (05:22:16 UTC)

Made the MATLAB_MEX_FILE #define get set globally to avoid any possibility of ODR violations.

Modified
dlib/matlab/cmake_mex_wrapper

Revision: c0a8dc483c27a986
Author: Davis King
Date: Feb 04, 2016 (04:25:57 UTC)

Clarified instructions

Modified
dlib/matlab/README.txt
dlib/matlab/example.m

Revision: 8ac7378da4fc3c83
Author: Davis King
Date: Feb 04, 2016 (04:19:13 UTC)

Now when you make a mex file with cmake it will only try to link to the BLAS and LAPACK that comes with MATLAB since trying to use any other BLAS or LAPACK generally makes MATLAB unstable.

Modified
dlib/cmake_find_blas.txt
dlib/matlab/cmake_mex_wrapper
dlib/matrix/lapack/fortran_id.h

Revision: c80c2d63fc6e4479
Author: Davis King
Date: Feb 04, 2016 (04:07:41 UTC)

Added a copy of CBLAS so we can use it when linking against a BLAS that doesn't have it.

Added
dlib/external/cblas/CMakeLists.txt
dlib/external/cblas/README
dlib/external/cblas/cblas.h
dlib/external/cblas/cblas_caxpy.c
dlib/external/cblas/cblas_ccopy.c
dlib/external/cblas/cblas_cdotc_sub.c
dlib/external/cblas/cblas_cdotu_sub.c
dlib/external/cblas/cblas_cgbmv.c
dlib/external/cblas/cblas_cgemm.c
dlib/external/cblas/cblas_cgemv.c
dlib/external/cblas/cblas_cgerc.c
dlib/external/cblas/cblas_cgeru.c
dlib/external/cblas/cblas_chbmv.c
dlib/external/cblas/cblas_chemm.c
dlib/external/cblas/cblas_chemv.c
dlib/external/cblas/cblas_cher.c
dlib/external/cblas/cblas_cher2.c
dlib/external/cblas/cblas_cher2k.c
dlib/external/cblas/cblas_cherk.c
dlib/external/cblas/cblas_chpmv.c
dlib/external/cblas/cblas_chpr.c
dlib/external/cblas/cblas_chpr2.c
dlib/external/cblas/cblas_cscal.c
dlib/external/cblas/cblas_csscal.c
dlib/external/cblas/cblas_cswap.c
dlib/external/cblas/cblas_csymm.c
dlib/external/cblas/cblas_csyr2k.c
dlib/external/cblas/cblas_csyrk.c
dlib/external/cblas/cblas_ctbmv.c
dlib/external/cblas/cblas_ctbsv.c
dlib/external/cblas/cblas_ctpmv.c
dlib/external/cblas/cblas_ctpsv.c
dlib/external/cblas/cblas_ctrmm.c
dlib/external/cblas/cblas_ctrmv.c
dlib/external/cblas/cblas_ctrsm.c
dlib/external/cblas/cblas_ctrsv.c
dlib/external/cblas/cblas_dasum.c
dlib/external/cblas/cblas_daxpy.c
dlib/external/cblas/cblas_dcopy.c
dlib/external/cblas/cblas_ddot.c
dlib/external/cblas/cblas_dgbmv.c
dlib/external/cblas/cblas_dgemm.c
dlib/external/cblas/cblas_dgemv.c
dlib/external/cblas/cblas_dger.c
dlib/external/cblas/cblas_dnrm2.c
dlib/external/cblas/cblas_drot.c
dlib/external/cblas/cblas_drotg.c
dlib/external/cblas/cblas_drotm.c
dlib/external/cblas/cblas_drotmg.c
dlib/external/cblas/cblas_dsbmv.c
dlib/external/cblas/cblas_dscal.c
dlib/external/cblas/cblas_dsdot.c
dlib/external/cblas/cblas_dspmv.c
dlib/external/cblas/cblas_dspr.c
dlib/external/cblas/cblas_dspr2.c
dlib/external/cblas/cblas_dswap.c
dlib/external/cblas/cblas_dsymm.c
dlib/external/cblas/cblas_dsymv.c
dlib/external/cblas/cblas_dsyr.c
dlib/external/cblas/cblas_dsyr2.c
dlib/external/cblas/cblas_dsyr2k.c
dlib/external/cblas/cblas_dsyrk.c
dlib/external/cblas/cblas_dtbmv.c
dlib/external/cblas/cblas_dtbsv.c
dlib/external/cblas/cblas_dtpmv.c
dlib/external/cblas/cblas_dtpsv.c
dlib/external/cblas/cblas_dtrmm.c
dlib/external/cblas/cblas_dtrmv.c
dlib/external/cblas/cblas_dtrsm.c
dlib/external/cblas/cblas_dtrsv.c
dlib/external/cblas/cblas_dzasum.c
dlib/external/cblas/cblas_dznrm2.c
dlib/external/cblas/cblas_f77.h
dlib/external/cblas/cblas_icamax.c
dlib/external/cblas/cblas_idamax.c
dlib/external/cblas/cblas_isamax.c
dlib/external/cblas/cblas_izamax.c
dlib/external/cblas/cblas_sasum.c
dlib/external/cblas/cblas_saxpy.c
dlib/external/cblas/cblas_scasum.c
dlib/external/cblas/cblas_scnrm2.c
dlib/external/cblas/cblas_scopy.c
dlib/external/cblas/cblas_sdot.c
dlib/external/cblas/cblas_sdsdot.c
dlib/external/cblas/cblas_sgbmv.c
dlib/external/cblas/cblas_sgemm.c
dlib/external/cblas/cblas_sgemv.c
dlib/external/cblas/cblas_sger.c
dlib/external/cblas/cblas_snrm2.c
dlib/external/cblas/cblas_srot.c
dlib/external/cblas/cblas_srotg.c
dlib/external/cblas/cblas_srotm.c
dlib/external/cblas/cblas_srotmg.c
dlib/external/cblas/cblas_ssbmv.c
dlib/external/cblas/cblas_sscal.c
dlib/external/cblas/cblas_sspmv.c
dlib/external/cblas/cblas_sspr.c
dlib/external/cblas/cblas_sspr2.c
dlib/external/cblas/cblas_sswap.c
dlib/external/cblas/cblas_ssymm.c
dlib/external/cblas/cblas_ssymv.c
dlib/external/cblas/cblas_ssyr.c
dlib/external/cblas/cblas_ssyr2.c
dlib/external/cblas/cblas_ssyr2k.c
dlib/external/cblas/cblas_ssyrk.c
dlib/external/cblas/cblas_stbmv.c
dlib/external/cblas/cblas_stbsv.c
dlib/external/cblas/cblas_stpmv.c
dlib/external/cblas/cblas_stpsv.c
dlib/external/cblas/cblas_strmm.c
dlib/external/cblas/cblas_strmv.c
dlib/external/cblas/cblas_strsm.c
dlib/external/cblas/cblas_strsv.c
dlib/external/cblas/cblas_xerbla.c
dlib/external/cblas/cblas_zaxpy.c
dlib/external/cblas/cblas_zcopy.c
dlib/external/cblas/cblas_zdotc_sub.c
dlib/external/cblas/cblas_zdotu_sub.c
dlib/external/cblas/cblas_zdscal.c
dlib/external/cblas/cblas_zgbmv.c
dlib/external/cblas/cblas_zgemm.c
dlib/external/cblas/cblas_zgemv.c
dlib/external/cblas/cblas_zgerc.c
dlib/external/cblas/cblas_zgeru.c
dlib/external/cblas/cblas_zhbmv.c
dlib/external/cblas/cblas_zhemm.c
dlib/external/cblas/cblas_zhemv.c
dlib/external/cblas/cblas_zher.c
dlib/external/cblas/cblas_zher2.c
dlib/external/cblas/cblas_zher2k.c
dlib/external/cblas/cblas_zherk.c
dlib/external/cblas/cblas_zhpmv.c
dlib/external/cblas/cblas_zhpr.c
dlib/external/cblas/cblas_zhpr2.c
dlib/external/cblas/cblas_zscal.c
dlib/external/cblas/cblas_zswap.c
dlib/external/cblas/cblas_zsymm.c
dlib/external/cblas/cblas_zsyr2k.c
dlib/external/cblas/cblas_zsyrk.c
dlib/external/cblas/cblas_ztbmv.c
dlib/external/cblas/cblas_ztbsv.c
dlib/external/cblas/cblas_ztpmv.c
dlib/external/cblas/cblas_ztpsv.c
dlib/external/cblas/cblas_ztrmm.c
dlib/external/cblas/cblas_ztrmv.c
dlib/external/cblas/cblas_ztrsm.c
dlib/external/cblas/cblas_ztrsv.c
dlib/external/cblas/cdotcsub.f
dlib/external/cblas/cdotusub.f
dlib/external/cblas/dasumsub.f
dlib/external/cblas/ddotsub.f
dlib/external/cblas/dnrm2sub.f
dlib/external/cblas/dsdotsub.f
dlib/external/cblas/dzasumsub.f
dlib/external/cblas/dznrm2sub.f
dlib/external/cblas/icamaxsub.f
dlib/external/cblas/idamaxsub.f
dlib/external/cblas/isamaxsub.f
dlib/external/cblas/izamaxsub.f
dlib/external/cblas/sasumsub.f
dlib/external/cblas/scasumsub.f
dlib/external/cblas/scnrm2sub.f
dlib/external/cblas/sdotsub.f
dlib/external/cblas/sdsdotsub.f
dlib/external/cblas/snrm2sub.f
dlib/external/cblas/zdotcsub.f
dlib/external/cblas/zdotusub.f

Revision: ca1e742fab6dc375
Author: Davis King
Date: Jan 31, 2016 (06:59:33 UTC)

Added random_color_transform and disturb_colors().

Modified
dlib/image_transforms.h
Added
dlib/image_transforms/random_color_transform.h
dlib/image_transforms/random_color_transform_abstract.h

Revision: 38d93c0ff9524bf6
Author: Davis King
Date: Jan 31, 2016 (05:55:19 UTC)

Minor cleanup

Modified
dlib/dnn/core_abstract.h

Revision: fcb24980a914daf8
Author: Davis King
Date: Feb 02, 2016 (08:28:36 UTC)

Added a function to check if the matlab user hit ctrl+c.

Modified
dlib/matlab/call_matlab.h
dlib/matlab/mex_wrapper.cpp

Revision: 016e9dad395bebce
Author: Davis King
Date: Feb 02, 2016 (07:39:07 UTC)

Made mex files always build with fPIC.

Modified
dlib/matlab/cmake_mex_wrapper

Revision: f3cce8e130311bd5
Author: Davis King
Date: Feb 02, 2016 (06:08:28 UTC)

Improved building of mex files.

Modified
dlib/cmake_find_blas.txt
dlib/matlab/cmake_mex_wrapper

Revision: a72b9fb25b8c8a6c
Author: Davis King
Date: Feb 02, 2016 (05:27:32 UTC)

Minor change to avoid compiler warnings

Modified
dlib/matlab/mex_wrapper.cpp

Revision: cd38fc35ea5b7f17
Author: Davis King
Date: Feb 01, 2016 (08:28:28 UTC)

Improved building of mex files with cmake.

Modified
dlib/cmake_find_blas.txt
dlib/matlab/cmake_mex_wrapper

Revision: f9f71460729bb2bf
Author: Davis King
Date: Jan 30, 2016 (04:52:24 UTC)

Changed the tensor serialization format to use a 4 byte little endian IEEE representation rather than dlib's default variable length encoding. This change makes the resulting serialized networks about 33% smaller.

Modified
dlib/dnn/tensor.h

Revision: d021c6451895ce02
Author: Davis King
Date: Jan 30, 2016 (04:23:49 UTC)

Added host_write_only() and device_write_only() to the gpu_data and tensor objects. Then made the relevant parts of the code use these functions.

Modified
dlib/dnn/cudnn_dlibapi.cpp
dlib/dnn/gpu_data.h
dlib/dnn/gpu_data_abstract.h
dlib/dnn/loss.h
dlib/dnn/tensor.h
dlib/dnn/tensor_abstract.h

Revision: 2976d50a09c8b2ba
Author: Davis King
Date: Jan 29, 2016 (10:23:39 UTC)

merged

Modified
dlib/cmake_find_blas.txt
dlib/matlab/cmake_mex_wrapper

Revision: 56b5d3b4e3949eb2
Author: Davis King
Date: Jan 28, 2016 (07:15:27 UTC)

Minor change to avoid compiler warning

Modified
dlib/matlab/mex_wrapper.cpp

Revision: 3e763e009f2cb1bd
Author: Davis King
Date: Jan 24, 2016 (12:32:04 UTC)

Added tests to make sure the GPU and CPU conv code does the same thing.

Modified
dlib/test/dnn.cpp

Revision: d1d06ef01d5b6b11
Author: Davis King
Date: Jan 24, 2016 (12:31:31 UTC)

Added CPU convolution implementation.

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cpu_dlib.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h

Revision: 1fcd46fe77e4abb4
Author: Davis King
Date: Jan 24, 2016 (10:46:05 UTC)

Added missing asserts

Modified
dlib/dnn/cudnn_dlibapi.cpp

Revision: 3deb9b500852fcf1
Author: Davis King
Date: Jan 24, 2016 (02:12:32 UTC)

removing cruft

Modified
dlib/dnn/tensor.h

Revision: 6fbf5146a8eff4b6
Author: Davis King
Date: Jan 24, 2016 (02:10:43 UTC)

Made affine_transform() routines a little faster.

Modified
dlib/dnn/cuda_dlib.cu

Revision: 61c6fe4ad6ac77ee
Author: Davis King
Date: Jan 24, 2016 (02:03:06 UTC)

Added a multiply_ layer and set it up so you can use it instead of dropout_ after training has finished.

Modified
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h
dlib/test/dnn.cpp

Revision: 9b213ea06310e1e1
Author: Davis King
Date: Jan 23, 2016 (15:06:11 UTC)

Made it so you can deserialize bn_ objects into affine_ objects.

Modified
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h

Revision: b6951a5ac1e6bf2a
Author: Davis King
Date: Jan 23, 2016 (14:52:48 UTC)

merged

Modified
dlib/CMakeLists.txt
dlib/algs.h
dlib/all/source.cpp
dlib/bridge.h
dlib/gui_widgets.h
dlib/image_io.h
dlib/image_loader/load_image.h
dlib/image_processing.h
dlib/image_transforms.h
dlib/matlab/cmake_mex_wrapper
dlib/opencv.h
dlib/platform.h
dlib/smart_pointers/shared_ptr.h
dlib/smart_pointers/shared_ptr_thread_safe.h
dlib/svm.h
dlib/svm_threaded.h
dlib/threads.h
dlib/vectorstream.h
docs/docs/algorithms.xml
docs/docs/compile.xml
docs/docs/dlib.css
docs/docs/other.xml
docs/docs/release_notes.xml
docs/docs/stylesheet.xsl
docs/docs/term_index.xml
setup.py
Added
dlib/dlib_basic_cpp_build_tutorial.txt
dlib/vectorstream/unserialize.h
dlib/vectorstream/unserialize_abstract.h

Revision: 8abb036b9a01c52a
Author: Davis King
Date: Jan 23, 2016 (14:48:47 UTC)

Made add_loss_layer's batch operator() more general.

Modified
dlib/dnn/core.h
dlib/dnn/core_abstract.h

Revision: 525d3d51cfce5fa4
Author: Davis King
Date: Jan 23, 2016 (07:06:51 UTC)

Added an overload of operator() that lets you easily run a network on an entire std::vector of objects.

Modified
dlib/dnn/core.h
dlib/dnn/core_abstract.h

Revision: 38de99005ce2f8b8
Author: Davis King
Date: Jan 23, 2016 (06:29:21 UTC)

Made the affine_ layer support being constructed from bn_ layers. Also added unit tests for the routines supporting this feature.

Modified
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h
dlib/test/dnn.cpp

Revision: 758c85cdd3552641
Author: Davis King
Date: Jan 23, 2016 (05:40:15 UTC)

Added affine_transform_conv() and multiply_conv() as well as a CPU implementation of assign_conv_bias_gradient().

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cpu_dlib.h
dlib/dnn/cuda_dlib.cu
dlib/dnn/cuda_dlib.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h

Revision: 5631d96e353d7509
Author: Davis King
Date: Jan 23, 2016 (05:37:21 UTC)

Added missing requirements check.

Modified
dlib/dnn/cudnn_dlibapi.cpp

Revision: 6fd3413502f29788
Author: Davis King
Date: Jan 23, 2016 (04:40:04 UTC)

Changed dot() so it doesn't call cublasSdot anymore since cublasSdot gives the wrong outputs sometimes.

Modified
dlib/dnn/cublas_dlibapi.cpp
dlib/dnn/cublas_dlibapi.h
dlib/dnn/tensor.h

Revision: 920d70b358de97bd
Author: Davis King
Date: Jan 22, 2016 (04:16:20 UTC)

Added grid_stride_range_y cuda tool

Modified
dlib/dnn/cuda_utils.h

Revision: 8782a6c892e33682
Author: Davis King
Date: Jan 17, 2016 (11:20:50 UTC)

Fixed typo in comment

Modified
dlib/dnn/tensor_tools.h

Revision: fc2fa25cd752ead4
Author: Davis King
Date: Jan 11, 2016 (15:38:04 UTC)

Made train_one_step() print stuff in verbose mode.

Modified
dlib/dnn/trainer.h

Revision: 90a115416d7a26fe
Author: Davis King
Date: Jan 09, 2016 (06:57:04 UTC)

Made trainer disk synchronization more reliable and efficient.

Modified
dlib/dnn/trainer.h

Revision: 04415fe2d3e46787
Author: Davis King
Date: Jan 09, 2016 (06:56:37 UTC)

Clarified spec

Modified
dlib/dnn/core_abstract.h

Revision: 4ffbafec5b301ebb
Author: Davis King
Date: Jan 09, 2016 (06:50:12 UTC)

Improved the dnn_trainer. In particular, it no longer makes a copy of the network (which would needlessly double VRAM usage). I also added a set_synchronization_file() method so you can tell it to automatically synchronize itself to disk every so often during training. This makes resuming an interrupted training session trivially easy.

Modified
dlib/dnn/trainer.h
dlib/dnn/trainer_abstract.h

Revision: 47584de0c1f05acb
Author: Davis King
Date: Jan 09, 2016 (04:39:07 UTC)

Increased the default sgd learning rate.

Modified
dlib/dnn/solvers.h
dlib/dnn/solvers_abstract.h

Revision: b5088e91a51b769a
Author: Davis King
Date: Jan 09, 2016 (04:37:00 UTC)

Now training will automatically reduce the learning rate when it is clear that the loss isn't being reduced. Also, there is a stopping condition now based on how large the current learning rate is. That is, training stops when the learning rate gets small enough and it is clear that no progress is being made.

Modified
dlib/dnn/core.h
dlib/dnn/core_abstract.h
dlib/dnn/solvers.h
dlib/dnn/solvers_abstract.h
dlib/dnn/trainer.h
dlib/dnn/trainer_abstract.h

Revision: 031aa9c62fbbb170
Author: Davis King
Date: Jan 09, 2016 (03:16:33 UTC)

saving comments

Modified
dlib/dnn/tensor.h

Revision: 09bf39a02a91cd07
Author: Davis King
Date: Jan 08, 2016 (02:48:41 UTC)

merged

Modified
dlib/cmake
Added
dlib/statistics/running_gradient.h
dlib/statistics/running_gradient_abstract.h

Revision: 824c094a07084fce
Author: Davis King
Date: Jan 04, 2016 (12:58:00 UTC)

Added CPU version of pooling layer code.

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cpu_dlib.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h

Revision: 71ca78a15574f9c7
Author: Davis King
Date: Jan 04, 2016 (12:55:59 UTC)

Improved outputs from test_layer().

Modified
dlib/dnn/core.h

Revision: 9a32f5482f4ee837
Author: Davis King
Date: Jan 03, 2016 (07:03:00 UTC)

Fixed a bug where the trainer didn't initialize the solvers unless you explicitly gave it a solver.

Modified
dlib/dnn/trainer.h

Revision: 0198bed120833512
Author: Davis King
Date: Jan 03, 2016 (06:44:54 UTC)

Made add() faster by calling my own version for the simple pointwise add case.

Modified
dlib/dnn/cuda_dlib.cu
dlib/dnn/cuda_dlib.h
dlib/dnn/cudnn_dlibapi.cpp

Revision: c72b909c2fddc7fc
Author: Davis King
Date: Jan 03, 2016 (06:21:40 UTC)

Wrapped new dot() function into the tt namespace and gave it a CPU version.

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cpu_dlib.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h

Revision: 67a811e56161ac38
Author: Davis King
Date: Jan 03, 2016 (06:20:49 UTC)

Added the launch_kernel() function that launches a kernel by smartly picking the number of threads and blocks rather than using the hard coded numbers I had in there. This makes some functions noticeably faster. Also added a dot() function that is fully asynchronous.

Modified
dlib/dnn/cuda_dlib.cu
dlib/dnn/cuda_dlib.h
dlib/dnn/cuda_utils.h

Revision: e7b7c200c1a417f2
Author: Davis King
Date: Jan 01, 2016 (16:50:50 UTC)

Made the tensor dot() function use cuBLAS.

Modified
dlib/dnn/cublas_dlibapi.cpp
dlib/dnn/cublas_dlibapi.h
dlib/dnn/tensor.h

Revision: 5094ed6ad85a89f9
Author: Davis King
Date: Dec 31, 2015 (17:58:20 UTC)

Fixed more serialization bugs

Modified
dlib/dnn/layers.h

Revision: c2f23b2b6cfde05b
Author: Davis King
Date: Dec 31, 2015 (17:23:14 UTC)

Added the repeat layer and generally optimized the code for really deep networks. This revolved mostly around removing really deep template recursions since that upsets the compiler when you make really deep networks.

Modified
dlib/dnn/core.h
dlib/dnn/core_abstract.h
dlib/dnn/trainer.h
dlib/dnn/trainer_abstract.h
dlib/test/dnn.cpp

Revision: d9084ab189fe718e
Author: Davis King
Date: Dec 31, 2015 (17:19:13 UTC)

Fixed a bug in the max_pool serialization functions.

Modified
dlib/dnn/layers.h

Revision: 49e6b8db1bbf581e
Author: Davis King
Date: Dec 30, 2015 (15:39:12 UTC)

Added a way to get the final gradient with respect to the inputs. Also added a method to more efficiently give the input gradient in some instances.

Modified
dlib/dnn/core.h
dlib/dnn/core_abstract.h

Revision: b47aefeb8fc08ce1
Author: Davis King
Date: Dec 30, 2015 (15:32:26 UTC)

Made add_layer hold subnetworks though a pointer so that most of a network is allocated on the heap rather than resulting in really large stack usage for large networks.

Modified
dlib/dnn/core.h

Revision: 9e8e0226fae38ee6
Author: Davis King
Date: Dec 30, 2015 (15:30:32 UTC)

Clarified spec

Modified
dlib/dnn/core_abstract.h

Revision: 961dbaacd122e046
Author: Davis King
Date: Dec 24, 2015 (06:30:16 UTC)

Added the add_prev_ layer

Modified
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h

Revision: 642e9b3fef5ebf7c
Author: Davis King
Date: Dec 24, 2015 (05:44:37 UTC)

Added another add() function for adding tensors. This one lets you add tensors with different sizes and it will zero pad them as needed.

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cpu_dlib.h
dlib/dnn/cuda_dlib.cu
dlib/dnn/cuda_dlib.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h
dlib/test/dnn.cpp

Revision: 651c3e69a3b1facf
Author: Davis King
Date: Dec 24, 2015 (05:40:53 UTC)

Added pack_idx() and unpack_idx().

Modified
dlib/dnn/cuda_utils.h

Revision: b7856158a417506c
Author: Davis King
Date: Dec 24, 2015 (04:23:22 UTC)

Made the tuple based layer constructors work with nested tuples so you can define combination layers made out of other combination layers without being hassled by the compiler.

Modified
dlib/dnn/core.h
dlib/dnn/core_abstract.h

Revision: 5bc2e5474da65da2
Author: Davis King
Date: Dec 23, 2015 (17:29:31 UTC)

Just renamed two functions to way better names.

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cpu_dlib.h
dlib/dnn/cuda_dlib.cu
dlib/dnn/cuda_dlib.h
dlib/dnn/cudnn_dlibapi.cpp
dlib/dnn/cudnn_dlibapi.h
dlib/dnn/layers.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h

Revision: 754efd0daae0b209
Author: Davis King
Date: Dec 23, 2015 (17:25:17 UTC)

Added an option to fc_ to enable or disable a bias term.

Modified
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h
dlib/test/dnn.cpp

Revision: c4bf6e31ffe255cc
Author: Davis King
Date: Dec 23, 2015 (16:44:21 UTC)

Added an avg_pool_ layer. Also fixed some errors in the layer specs.

Modified
dlib/dnn/cudnn_dlibapi.cpp
dlib/dnn/cudnn_dlibapi.h
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h
dlib/test/dnn.cpp

Revision: 484f9ed89233a32d
Author: Davis King
Date: Dec 23, 2015 (16:31:35 UTC)

Change to suppress compiler warning.

Modified
dlib/dnn/core.h

Revision: 3e40078e296e6be3
Author: Davis King
Date: Dec 23, 2015 (15:58:31 UTC)

Fixed the tag and skip layers so they compile now that we have the in-place/out-of-place logic present.

Modified
dlib/dnn/core.h

Revision: faccec2a17af5d4c
Author: Davis King
Date: Dec 23, 2015 (15:18:04 UTC)

Clarified spec

Modified
dlib/dnn/layers_abstract.h

Revision: 92e520e8ba9ab185
Author: Davis King
Date: Dec 23, 2015 (03:23:46 UTC)

Made the default input layer automatically normalize unsigned char pixel values to the range [0,1].

Modified
dlib/dnn/input.h
dlib/dnn/input_abstract.h

Revision: 299015aff5570e56
Author: Davis King
Date: Dec 23, 2015 (03:05:08 UTC)

Reverted cmake file back to it's proper state. Oops.

Modified
dlib/test/CMakeLists.txt

Revision: 1d8869b9284d4758
Author: Davis King
Date: Dec 23, 2015 (03:03:31 UTC)

Made computed_output an optional argument to backward_inplace() so there is symmetry between the non-inplace version. This also enables additional optimizations in the resulting network.

Modified
dlib/dnn/core.h
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h

Revision: e3c43a2345a47c6d
Author: Davis King
Date: Dec 22, 2015 (17:01:00 UTC)

Upgraded to cuDNN v4.0. This means changing the binding to max_pool a little since that's a little different in cuDNN. I also removed my CUDA code for doing batch normalization and replaced it with cuDNN's new batch normalization methods. Finally, I forgot to add a convolutional option to the bn_ object. Now it has one so you can set the mode however you like, either BATCH_NORM_FC or BATCH_NORM_CONV.

Modified
dlib/CMakeLists.txt
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cpu_dlib.h
dlib/dnn/cuda_dlib.cu
dlib/dnn/cuda_dlib.h
dlib/dnn/cudnn_dlibapi.cpp
dlib/dnn/cudnn_dlibapi.h
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h
dlib/test/CMakeLists.txt
dlib/test/dnn.cpp

Revision: c6e2356cb1e89046
Author: Davis King
Date: Dec 16, 2015 (18:11:03 UTC)

Gave the batch normalization layer an automatic testing mode that causes it to use the saved average mean and invstd to scale the data instead of normalizing the batch.

Modified
dlib/dnn/layers.h

Revision: f3ee4e0e31d46f14
Author: Davis King
Date: Dec 15, 2015 (14:43:09 UTC)

Added specs for bn, affine, and max_pool layers.

Modified
dlib/dnn/layers_abstract.h

Revision: eea644b6c856ce39
Author: Davis King
Date: Dec 14, 2015 (15:12:06 UTC)

Changed the type used to represent labels so it's more consistent with other parts of the library.

Modified
dlib/data_io/mnist.cpp
dlib/data_io/mnist.h
dlib/data_io/mnist_abstract.h

Revision: 353205b72cbf02a5
Author: Davis King
Date: Dec 13, 2015 (07:46:18 UTC)

Added spec for loss_multiclass_log_ and fixed some typos.

Modified
dlib/dnn/loss_abstract.h

Revision: 67a0e64b9c7d11d9
Author: Davis King
Date: Dec 13, 2015 (07:21:54 UTC)

Added loss_multiclass_log_

Modified
dlib/dnn/loss.h

Revision: 3f4013332041ae07
Author: Davis King
Date: Dec 13, 2015 (07:21:25 UTC)

Fixed errant const.

Modified
dlib/dnn/trainer.h
dlib/dnn/trainer_abstract.h

Revision: da61dfb5e2a9a3c9
Author: Davis King
Date: Dec 12, 2015 (07:59:29 UTC)

Fixed old tests. Also added more max pooling tests.

Modified
dlib/test/dnn.cpp

Revision: 4b23fc41f333d727
Author: Davis King
Date: Dec 12, 2015 (07:53:43 UTC)

Added test for max pool layer.

Modified
dlib/test/dnn.cpp

Revision: 4f9c18d8c6ff8df6
Author: Davis King
Date: Dec 12, 2015 (07:53:27 UTC)

Added max_pool_ layer.

Modified
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h

Revision: 18906b90eedee92c
Author: Davis King
Date: Dec 12, 2015 (07:52:32 UTC)

Fixed some resource leaks. Also fixed max_pool so it does exactly what the spec says it should.

Modified
dlib/dnn/cudnn_dlibapi.cpp
dlib/dnn/cudnn_dlibapi.h

Revision: b4bdec60f7ae2ecf
Author: Davis King
Date: Dec 12, 2015 (07:51:29 UTC)

Made test_layers() a little more robust.

Modified
dlib/dnn/core.h

Revision: ea3ea031cfbeb988
Author: Davis King
Date: Dec 12, 2015 (07:05:09 UTC)

removed cruft

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cpu_dlib.h
dlib/dnn/cuda_dlib.cu
dlib/dnn/cuda_dlib.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h

Revision: 56ae2ccc432426ee
Author: Davis King
Date: Dec 12, 2015 (07:01:47 UTC)

Improved softmax tests

Modified
dlib/test/dnn.cpp

Revision: 346c41f41c90201c
Author: Davis King
Date: Dec 12, 2015 (07:01:27 UTC)

Fixed bug in softmax gradient computation.

Modified
dlib/dnn/cpu_dlib.cpp

Revision: 9063377c13bb1a5a
Author: Davis King
Date: Dec 12, 2015 (05:33:27 UTC)

updated tests

Modified
dlib/test/dnn.cpp

Revision: 5cda4ddda5da9807
Author: Davis King
Date: Dec 12, 2015 (05:33:13 UTC)

Figured out the *undocumented* requirements for calling cuDNN's cudnnAddTensor() function and updated the specs and asserts accordingly.

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cudnn_dlibapi.cpp
dlib/dnn/cudnn_dlibapi.h
dlib/dnn/tensor_tools.h

Revision: 30f023570d4cd714
Author: Davis King
Date: Dec 12, 2015 (05:31:50 UTC)

Fixed race condition that could happen if set_size() was called while a cuda kernel was still running.

Modified
dlib/dnn/gpu_data.cpp

Revision: f6a19d62569b71cb
Author: Davis King
Date: Dec 08, 2015 (17:53:51 UTC)

saving tests for add()

Modified
dlib/test/dnn.cpp

Revision: eb88bdd387de9f7c
Author: Davis King
Date: Dec 08, 2015 (17:53:13 UTC)

Improved cudnn error messages.

Modified
dlib/dnn/cudnn_dlibapi.cpp

Revision: 306149ea052e2387
Author: Davis King
Date: Dec 08, 2015 (17:53:02 UTC)

Made test_layer() more robust.

Modified
dlib/dnn/core.h

Revision: de559b7434659633
Author: Davis King
Date: Dec 08, 2015 (17:25:00 UTC)

Updated multiply()'s CUDA implementation to reflect it's new features. Also added CUDA version of add_bias_gradient().

Modified
dlib/dnn/cuda_dlib.cu
dlib/dnn/cuda_dlib.h
dlib/dnn/cuda_utils.h
dlib/dnn/layers_abstract.h
dlib/dnn/tensor_tools.cpp
dlib/test/dnn.cpp

Revision: 58a3801cf2451813
Author: Davis King
Date: Dec 08, 2015 (16:32:48 UTC)

Added affine_ layer.

Modified
dlib/dnn/layers.h

Revision: b56d3f684a9b4333
Author: Davis King
Date: Dec 08, 2015 (16:32:32 UTC)

Added cpu version of add() and also added new add_bias_gradient() function.

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cpu_dlib.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h

Revision: a4ef62e12f95ba67
Author: Davis King
Date: Dec 08, 2015 (16:31:44 UTC)

Added missing assert check

Modified
dlib/dnn/cudnn_dlibapi.cpp

Revision: 4b9f4615b97d8db4
Author: Davis King
Date: Dec 08, 2015 (13:49:12 UTC)

Made multiply() more flexible and also fixed a bug in the CPU implementation of batch_normalize_conv.

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h
dlib/test/dnn.cpp

Revision: f2908a17d70d3b9e
Author: Davis King
Date: Dec 08, 2015 (12:44:48 UTC)

Made the affine_transform functions consistent.

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cpu_dlib.h
dlib/dnn/cuda_dlib.cu
dlib/dnn/cuda_dlib.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h

Revision: 3023f037f051a722
Author: Davis King
Date: Dec 08, 2015 (12:18:34 UTC)

Added the dropout layer

Modified
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h

Revision: bc74ff167d88fc9b
Author: Davis King
Date: Dec 08, 2015 (03:25:29 UTC)

Clarified spec

Modified
dlib/dnn/layers_abstract.h

Revision: 538d4b02842ada2e
Author: Davis King
Date: Dec 08, 2015 (03:25:11 UTC)

Added another version of multiply()

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cpu_dlib.h
dlib/dnn/cuda_dlib.cu
dlib/dnn/cuda_dlib.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h

Revision: c68e6fc5a42533b9
Author: Davis King
Date: Dec 07, 2015 (16:43:39 UTC)

Added bn layer tests.

Modified
dlib/test/dnn.cpp

Revision: 260008c84e36f20b
Author: Davis King
Date: Dec 07, 2015 (16:43:24 UTC)

Implemented the bn layer.

Modified
dlib/dnn/layers.h

Revision: 519a14f2e5bf704c
Author: Davis King
Date: Dec 07, 2015 (16:42:45 UTC)

Increased default mini-batch size to 32.

Modified
dlib/dnn/trainer.h

Revision: e7354372d8573313
Author: Davis King
Date: Dec 07, 2015 (16:42:22 UTC)

Made the batch normalization code assign the parameter gradient outputs instead of add to them so that it's consistent with how the layer interface expects this to be done.

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cuda_dlib.cu
dlib/dnn/tensor_tools.h

Revision: f7d27d6c787a1b3f
Author: Davis King
Date: Dec 07, 2015 (16:40:53 UTC)

Relaxed test_layer() a little.

Modified
dlib/dnn/core.h

Revision: 8155d9d71bef41a1
Author: Davis King
Date: Dec 06, 2015 (07:22:32 UTC)

Added conv_ spec and did a little cleanup.

Modified
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h

Revision: a8ef56ce5a99c211
Author: Davis King
Date: Dec 06, 2015 (07:10:07 UTC)

code cleanup

Modified
dlib/dnn/core.h

Revision: 6153ecf6b49394dc
Author: Davis King
Date: Dec 06, 2015 (07:08:45 UTC)

Set initial bias parameters to 0.

Modified
dlib/dnn/layers.h

Revision: 2549c3815ea13673
Author: Davis King
Date: Dec 06, 2015 (07:07:32 UTC)

Added a convolution layer.

Modified
dlib/dnn/layers.h
dlib/test/dnn.cpp

Revision: 61ef5302b627299b
Author: Davis King
Date: Dec 06, 2015 (07:06:57 UTC)

Yet more robustness tweaks for test_layer().

Modified
dlib/dnn/core.h

Revision: ace2b2465f2e4360
Author: Davis King
Date: Dec 06, 2015 (06:46:54 UTC)

More robustness tweaks for test_layer()

Modified
dlib/dnn/core.h

Revision: 011091fc001019ee
Author: Davis King
Date: Dec 06, 2015 (06:44:58 UTC)

Cleaned up the tensor_conv interface a little. Also fixed an error in the spec for this object.

Modified
dlib/dnn/cudnn_dlibapi.cpp
dlib/dnn/cudnn_dlibapi.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h

Revision: fd429392ca58fa1a
Author: Davis King
Date: Dec 06, 2015 (06:43:38 UTC)

Made alias_tensor serializable.

Modified
dlib/dnn/tensor.h
dlib/dnn/tensor_abstract.h

Revision: e32184066d2e5a17
Author: Davis King
Date: Dec 06, 2015 (06:42:41 UTC)

Made test_layer() a little more robust.

Modified
dlib/dnn/core.h

Revision: 78fc0a7b19a9690d
Author: Davis King
Date: Dec 05, 2015 (06:13:02 UTC)

Added GPU versions of the batch normalization functions.

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cuda_dlib.cu
dlib/test/dnn.cpp

Revision: e632a17da59383eb
Author: Davis King
Date: Dec 01, 2015 (15:11:00 UTC)

fixed compile time error

Modified
dlib/dnn/tensor.h

Revision: 9939d311e9c9eeba
Author: Davis King
Date: Dec 01, 2015 (03:18:13 UTC)

Minor cleanup

Modified
dlib/dnn/cudnn_dlibapi.cpp

Revision: ce8252bc3a7631ec
Author: Davis King
Date: Dec 01, 2015 (03:13:17 UTC)

Added tests for the alias_tensor.

Modified
dlib/test/dnn.cpp

Revision: 88d694e07fb17496
Author: Davis King
Date: Dec 01, 2015 (03:00:01 UTC)

Minor change to avoid compiler warnings

Modified
dlib/dnn/cuda_dlib.h
dlib/test/dnn.cpp

Revision: 70cc101f4cfb29f0
Author: Davis King
Date: Nov 30, 2015 (13:30:49 UTC)

Cleaned up the tensor code a bit and also added a tool for making aliased tensors.

Modified
dlib/dnn/tensor.h
dlib/dnn/tensor_abstract.h

Revision: 35b0b1dc53d49c07
Author: Davis King
Date: Nov 29, 2015 (08:02:56 UTC)

fixed missing return

Modified
dlib/dnn/cuda_dlib.h

Revision: afda627e8e61c23d
Author: Davis King
Date: Nov 29, 2015 (07:58:35 UTC)

Gave dnn_trainer the ability to train on out of core data by adding the train_one_step() member function. Also improved how the host to device transfers are overlapped with kernel computation.

Modified
dlib/dnn/core.h
dlib/dnn/cuda_dlib.cu
dlib/dnn/cuda_dlib.h
dlib/dnn/trainer.h
dlib/dnn/trainer_abstract.h

Revision: affdb37a4874c273
Author: Davis King
Date: Nov 29, 2015 (07:07:03 UTC)

Made the host to device copying code wait for any outstanding kernel executions to finish before overwriting the device memory with updated values from the host.

Modified
dlib/dnn/gpu_data.cpp
dlib/dnn/gpu_data.h
dlib/dnn/gpu_data_abstract.h

Revision: 3fe40a5f6859f3a0
Author: Davis King
Date: Nov 29, 2015 (07:07:47 UTC)

Fixed spelling error in comment.

Modified
dlib/dnn/core.h

Revision: 8da722cc20fe2be7
Author: Davis King
Date: Nov 29, 2015 (03:58:40 UTC)

Made cuBLAS and cuDNN automatically switch their library handles to the currently active device id if the user changes the active device via a call to cudaSetDevice().

Modified
dlib/dnn/cublas_dlibapi.cpp
dlib/dnn/cudnn_dlibapi.cpp

Revision: 3439e2627f112f7d
Author: Davis King
Date: Nov 26, 2015 (08:53:11 UTC)

Cleaned up cuda error handling code

Modified
dlib/dnn/cublas_dlibapi.cpp
dlib/dnn/cublas_dlibapi.h
dlib/dnn/cuda_errors.h
dlib/dnn/cudnn_dlibapi.cpp
dlib/dnn/curand_dlibapi.cpp
dlib/dnn/curand_dlibapi.h

Revision: a6b6883a940c1499
Author: Davis King
Date: Nov 21, 2015 (11:43:26 UTC)

Fixed a compile time bug.

Modified
dlib/dnn/core.h

Revision: e521043ff50e06f0
Author: Davis King
Date: Nov 21, 2015 (11:33:01 UTC)

Finished the bindings in this file

Modified
dlib/dnn/tensor_tools.cpp

Revision: 6d7cb347d254c340
Author: Davis King
Date: Nov 21, 2015 (11:31:56 UTC)

Added cuda tests

Modified
dlib/test/dnn.cpp

Revision: 8aa0fbfe69fd9726
Author: Davis King
Date: Nov 21, 2015 (11:31:13 UTC)

Added cuda implementations of a bunch of functions.

Modified
dlib/dnn/cuda_dlib.cu

Revision: f7e9f8a3d45c568c
Author: Davis King
Date: Nov 21, 2015 (08:48:41 UTC)

Added more stuff to tests

Modified
dlib/test/cublas.cpp

Revision: d0706c1707e828f4
Author: Davis King
Date: Nov 21, 2015 (05:42:39 UTC)

Made loss layers output the gradients by assigning them to the output rather than adding them. This way, the gradient buffer can be used as scratch space during the loss computation.

Modified
dlib/dnn/loss.h
dlib/dnn/loss_abstract.h

Revision: 23812903cf42d464
Author: Davis King
Date: Nov 21, 2015 (05:37:00 UTC)

Added more gemm() tests

Modified
dlib/test/cublas.cpp

Revision: dc325dda5c9315bd
Author: Davis King
Date: Nov 21, 2015 (04:39:07 UTC)

Fixed cmake lists so it compiles correctly without C++11

Modified
dlib/test/CMakeLists.txt

Revision: a76fb0d89e587254
Author: Davis King
Date: Nov 21, 2015 (04:37:51 UTC)

Fixed minor bug

Modified
dlib/dnn/tensor_tools.h

Revision: e18b912e81183ef0
Author: Davis King
Date: Nov 21, 2015 (04:36:50 UTC)

Changed gemm so it doesn't cause device to host copies in the assert statements.

Modified
dlib/dnn/cublas_dlibapi.cpp

Revision: be33d27cd962f06b
Author: Davis King
Date: Nov 20, 2015 (13:20:36 UTC)

fixed compiler errors

Modified
dlib/test/dnn.cpp

Revision: b2778e72a62e5134
Author: Davis King
Date: Nov 20, 2015 (13:20:16 UTC)

Added batch normalization layer skeleton

Modified
dlib/dnn/layers.h

Revision: bccba5e23908078a
Author: Davis King
Date: Nov 20, 2015 (13:19:56 UTC)

Removed cruft

Modified
dlib/dnn/cpu_dlib.cpp

Revision: 78e1bf5b05e5085c
Author: Davis King
Date: Nov 20, 2015 (12:50:09 UTC)

Added sigmoid, tanh, and softmax layers. Also added log loss layer.

Modified
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h
dlib/dnn/loss.h
dlib/dnn/loss_abstract.h

Revision: 63e38c616e900ed1
Author: Davis King
Date: Nov 20, 2015 (03:02:32 UTC)

Added log1pexp()

Modified
dlib/dnn/core.h
dlib/dnn/core_abstract.h

Revision: 6170091bd731bd1f
Author: Davis King
Date: Nov 19, 2015 (03:58:23 UTC)

Fixed a compile time bug.

Modified
dlib/dnn/core.h

Revision: ca6f21df2cfc5600
Author: Davis King
Date: Nov 18, 2015 (13:32:28 UTC)

Implemented CPU version of tanh

Modified
dlib/dnn/cpu_dlib.cpp
dlib/test/dnn.cpp

Revision: cbbd46199086472e
Author: Davis King
Date: Nov 18, 2015 (13:26:21 UTC)

Implemented the CPU version of softmax

Modified
dlib/dnn/cpu_dlib.cpp
dlib/test/dnn.cpp

Revision: 809fdd7e2c85871d
Author: Davis King
Date: Nov 18, 2015 (03:52:03 UTC)

Added CPU implementation of sigmoid() and sigmoid_gradient()

Modified
dlib/dnn/cpu_dlib.cpp
dlib/test/dnn.cpp

Revision: b6602cdd53059224
Author: Davis King
Date: Nov 18, 2015 (03:27:24 UTC)

removed cruft

Modified
dlib/dnn/loss.h

Revision: 2be9579bf0d3bbf0
Author: Davis King
Date: Nov 18, 2015 (03:26:48 UTC)

Added more kinds of affine_transform(), made the solver use affine_transform() so it runs on the GPU, and made affine_transform() take only tensors.

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cpu_dlib.h
dlib/dnn/cuda_dlib.h
dlib/dnn/solvers.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h
dlib/test/dnn.cpp

Revision: 7933930e73fefaf4
Author: Davis King
Date: Nov 16, 2015 (13:29:09 UTC)

Finished tensor_rand constructor.

Modified
dlib/dnn/tensor_tools.cpp

Revision: 178ecc615bbdf1a1
Author: Davis King
Date: Nov 16, 2015 (13:21:37 UTC)

Code cleanup

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cpu_dlib.h
dlib/dnn/cuda_dlib.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h
dlib/test/dnn.cpp

Revision: caf780320d0b3451
Author: Davis King
Date: Nov 16, 2015 (13:04:05 UTC)

More batch normalization optimizations.

Modified
dlib/dnn/cpu_dlib.cpp

Revision: 97042184093c62b3
Author: Davis King
Date: Nov 16, 2015 (12:28:10 UTC)

Optimized batch normalization code

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cpu_dlib.h
dlib/dnn/cuda_dlib.h
dlib/dnn/tensor_tools.h

Revision: 84d2464d36d74a1d
Author: Davis King
Date: Nov 16, 2015 (03:55:00 UTC)

More activation layer updates. Now the relu and fc layer objects use either CPU or GPU. Fixed a bug in gemm().

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cpu_dlib.h
dlib/dnn/cudnn_dlibapi.cpp
dlib/dnn/cudnn_dlibapi.h
dlib/dnn/layers.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h

Revision: b860fdb4da819c58
Author: Davis King
Date: Nov 13, 2015 (11:07:32 UTC)

Added a check for constexpr

Modified
dlib/use_cpp_11.cmake

Revision: 2cc7e09434635ee3
Author: Davis King
Date: Nov 13, 2015 (10:52:19 UTC)

Changed the API for functions that can operate in-place to a more appropriate form.

Modified
dlib/dnn/cudnn_dlibapi.cpp
dlib/dnn/cudnn_dlibapi.h
dlib/dnn/tensor_tools.cpp
dlib/dnn/tensor_tools.h

Revision: 024ae8ff5149ddeb
Author: Davis King
Date: Nov 13, 2015 (10:32:14 UTC)

Upgrade the layer interface so that you can implement layers that operate in-place.

Modified
dlib/dnn/core.h
dlib/dnn/core_abstract.h
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h

Revision: 88c5de0f5ee14f94
Author: Davis King
Date: Nov 13, 2015 (05:25:00 UTC)

removed print statements

Modified
dlib/dnn/gpu_data.cpp

Revision: 773bfa09d9485016
Author: Davis King
Date: Nov 13, 2015 (05:11:44 UTC)

Added missing requirements

Modified
dlib/dnn/cudnn_dlibapi.h
dlib/dnn/curand_dlibapi.h

Revision: 010648cc8c6eb218
Author: Davis King
Date: Nov 11, 2015 (13:13:54 UTC)

removed cruft

Modified
dlib/dnn/cudnn_dlibapi.h

Revision: 705338e5cffe414c
Author: Davis King
Date: Nov 11, 2015 (13:09:02 UTC)

updated specs

Modified
dlib/dnn/tensor_tools.h

Revision: b5e3e33fd6c711e4
Author: Davis King
Date: Nov 11, 2015 (12:59:40 UTC)

Removed unnecessary zero initialization of parameter gradients in core.h.

Modified
dlib/dnn/core.h
dlib/dnn/cudnn_dlibapi.cpp
dlib/dnn/cudnn_dlibapi.h
dlib/dnn/layers.h
dlib/dnn/layers_abstract.h

Revision: 6ebaaf146ce4c8b7
Author: Davis King
Date: Nov 11, 2015 (12:13:34 UTC)

Clarified specs

Modified
dlib/dnn/cudnn_dlibapi.h

Revision: 33a6e6170a5975e5
Author: Davis King
Date: Nov 10, 2015 (03:44:16 UTC)

clarified spec

Modified
dlib/dnn/loss_abstract.h

Revision: ba3eb4897d59e4f4
Author: Davis King
Date: Nov 09, 2015 (15:25:35 UTC)

fixed compile time bugs

Modified
dlib/dnn/tensor_tools.cpp

Revision: 0f026cc1e8582bca
Author: Davis King
Date: Nov 09, 2015 (13:29:56 UTC)

Added part of the tensor_tools implementations

Modified
dlib/CMakeLists.txt
dlib/all/source.cpp
dlib/dnn.h
dlib/dnn/cpu_dlib.h
dlib/dnn/tensor_tools.h
Added
dlib/dnn/tensor_tools.cpp

Revision: a4cc5d2eff852994
Author: Davis King
Date: Nov 09, 2015 (13:18:51 UTC)

Renamed conv to tensor_conv

Modified
dlib/dnn/cudnn_dlibapi.cpp
dlib/dnn/cudnn_dlibapi.h

Revision: f8ee2e87e021cbd8
Author: Davis King
Date: Nov 09, 2015 (12:56:25 UTC)

Made a tensor iterable

Modified
dlib/dnn/tensor.h
dlib/dnn/tensor_abstract.h

Revision: eeae425593704ab3
Author: Davis King
Date: Nov 09, 2015 (12:37:15 UTC)

Added tests for some of the new tensor operators.

Modified
dlib/test/dnn.cpp

Revision: de91c1ed3c99a1ae
Author: Davis King
Date: Nov 09, 2015 (12:29:41 UTC)

Added the header containing the prototypes that call into either the CPU or GPU code based on how dlib was built. All the layer implementations will interact with these functions.

Added
dlib/dnn/tensor_tools.h

Revision: 0a80f73e0ff27e30
Author: Davis King
Date: Nov 09, 2015 (12:28:47 UTC)

Implemented the CPU side of the tools in cuda_dlib.h and also cleaned some things up a bit.

Modified
dlib/dnn/cpu_dlib.cpp
dlib/dnn/cpu_dlib.h
dlib/dnn/cuda_dlib.h