facebookresearch/faiss
1
0
Fork 0
mirror of https://github.com/facebookresearch/faiss.git synced 2026-10-11 22:50:00 +00:00
Code Issues Packages Projects Releases Wiki Activity
2,354 Commits 267 Branches 33 Tags
main
Commit Graph
100 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Lucas Hosseini 19147f241e Fix OSX CI. (#2482) 
Summary:
Fixes OSX CI by pinning pytorch version for interop tests. The "real" fix is already landed in pytorch but has not been released yet.

Pull Request resolved: https://github.com/facebookresearch/faiss/pull/2482

Reviewed By: alexanderguzhva

Differential Revision: D39891113

Pulled By: beauby

fbshipit-source-id: fa79bf9de1c93e056260ea64613e37625edfecc3
 2022-09-28 11:22:43 -07:00
Lucas Hosseini 384dc32031 Fix Windows packages. (#2496) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/2496

Reviewed By: alexanderguzhva

Differential Revision: D39859408

Pulled By: beauby

fbshipit-source-id: b3bd06374bc0a815d297d972e0277d56c5789a66
 2022-09-28 07:05:09 -07:00
Lucas Hosseini 71cc92e437 Fix gpu packages. (#2495) 
Summary:
CentOS 8 being EOL, some modifications to the OS packages repositories
are needed in order to keep the build working.

Pull Request resolved: https://github.com/facebookresearch/faiss/pull/2495

Reviewed By: alexanderguzhva

Differential Revision: D39857306

Pulled By: beauby

fbshipit-source-id: 175f436132c589a9a22d93727bb58e556a43a8f6
 2022-09-28 07:02:37 -07:00
Lucas Hosseini c08cbff1a4 Prepare for v1.7.2 release. (#2151) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/2151

Reviewed By: mdouze

Differential Revision: D33157463

Pulled By: beauby

fbshipit-source-id: 8f8580a7ad953484f41fbbb2d001f3484fab4c3d
 2021-12-16 15:44:23 -08:00
Lucas Hosseini a0de37bd18 Update CUDA driver on CircleCI. (#2146) 
Summary:
A recent CUDA driver is required for building packages for CUDA 11.3.

Pull Request resolved: https://github.com/facebookresearch/faiss/pull/2146

Reviewed By: wickedfoo

Differential Revision: D33020204

Pulled By: beauby

fbshipit-source-id: 01257b1dcb4987f4866cc058c22d1dd5977d76ce
 2021-12-10 10:14:28 -08:00
Lucas Hosseini 7492d23354 Fix packaging (#2121) 
Summary:
- Disable problematic tests on OSX.
- Ensure compiler compatibility with CUDA builds.
- Fix path for Python extension libraries.
- Use CentOS for CUDA packaging.
- Update CUDA versions in CI (10.2 and 11.3).

Pull Request resolved: https://github.com/facebookresearch/faiss/pull/2121

Reviewed By: mdouze

Differential Revision: D32921117

Pulled By: beauby

fbshipit-source-id: 588c18add8084b8228ff5abc651eaa4567919cc6
 2021-12-07 13:12:30 -08:00
Lucas Hosseini 79e74fe307 Generate python docstrings from doxygen comments. (#1969) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1969

Reviewed By: mdouze

Differential Revision: D31084784

Pulled By: beauby

fbshipit-source-id: 32b152f10fde9a0f5299909b8fd5c855fe738996
 2021-10-10 22:14:48 -07:00
Lucas Hosseini b4eb51dae8 Change default branch references from master to main. (#2029) 
Summary:
This is required for the renaming of the default branch from `master` to `main`, in accordance with the new Facebook OSS guidelines.

Pull Request resolved: https://github.com/facebookresearch/faiss/pull/2029

Reviewed By: mdouze

Differential Revision: D30672862

Pulled By: beauby

fbshipit-source-id: 0b6458a4ff02a12aae14cf94057e85fdcbcbff96
 2021-09-01 09:26:20 -07:00
Lucas Hosseini 797bc88566 Add missing includes for std::min/std::max. (#1895) 
Summary:
Closes https://github.com/facebookresearch/faiss/issues/1876.

Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1895

Reviewed By: mdouze

Differential Revision: D28511225

Pulled By: beauby

fbshipit-source-id: 6dc6d0662983fdac7eef516f41fea1368195fb3e
 2021-05-18 10:42:09 -07:00
Lucas Hosseini 77825c52bd Fix conda recipes. (#1894) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1894

Reviewed By: wickedfoo

Differential Revision: D28510244

Pulled By: beauby

fbshipit-source-id: 32983b7eeab497b8d576caaadd56e13a2134a4ab
 2021-05-18 09:10:54 -07:00
Lucas Hosseini 06f1ef86ac Use larger instances for GPU builds. (#1794) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1794

Reviewed By: mdouze

Differential Revision: D27439445

Pulled By: beauby

fbshipit-source-id: 12a936766ccb49a27767ab3a36ffd37fec2e1bfc
 2021-04-01 03:35:41 -07:00
Lucas Hosseini c65f670523 Add separate targets for libfaiss/libfaiss_avx2. (#1772) 
Summary:
This should fix the conda builds.

Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1772

Reviewed By: mdouze

Differential Revision: D27365772

Pulled By: beauby

fbshipit-source-id: 12b9d488d475842030feb1a0452acf26dbe6ac01
 2021-03-26 14:28:16 -07:00
Lucas Hosseini d67689c8f7 Use larger instance for AVX2 CI. (#1768) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1768

Reviewed By: mdouze

Differential Revision: D27164105

Pulled By: beauby

fbshipit-source-id: a80c8581ae28ef415ead90e709e97b64bff8e168
 2021-03-18 14:34:31 -07:00
Lucas Hosseini 5e54fb57d8 Add missing copyright header. (#1751) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1751

Reviewed By: LowikC

Differential Revision: D26954273

Pulled By: beauby

fbshipit-source-id: f3e4cb825283a7571ec44b123146ebc06d4a3a9c
 2021-03-10 13:49:49 -08:00
Lucas Hosseini dd85e7a167 Add test for CPU dispatch in conda packages. (#1724) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1724

Reviewed By: mdouze

Differential Revision: D26814141

Pulled By: beauby

fbshipit-source-id: 11f32c6e04a7d78dab9dae48b8d951dd80c11353
 2021-03-09 01:18:22 -08:00
Lucas Hosseini 4314c5baa6 Add CI job for AVX2 builds. (#1723) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1723

Reviewed By: mdouze

Differential Revision: D26814122

Pulled By: beauby

fbshipit-source-id: ef7ea57b497e314960319c695ea46f22de208054
 2021-03-04 03:43:11 -08:00
Lucas Hosseini 4e5fa635ac Add CircleCI job to check format through clang-format. (#1710) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1710

Reviewed By: mdouze

Differential Revision: D26691243

Pulled By: beauby

fbshipit-source-id: ddaa2f3e28a23bbc9652aee0c3f8e6927918bdf2
 2021-03-03 06:49:10 -08:00
Lucas Hosseini 442c4317a0 Avoid building packages for compute_86 with CUDA 11.0. (#1694) 
Summary:
Compute capability 86 is only available from CUDA 11.1 onwards, for
which Anaconda does not have a `cudatoolkit` package yet.

Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1694

Reviewed By: wickedfoo

Differential Revision: D26482788

Pulled By: beauby

fbshipit-source-id: c0c84e0433ea9d9b04a1572001bd7c0d2ee82988
 2021-02-17 09:53:24 -08:00
Lucas Hosseini 2a01135127 Add missing copyright headers. (#1689) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1689

Reviewed By: mdouze

Differential Revision: D26460606

Pulled By: beauby

fbshipit-source-id: ad35dd2ea3fb23a0b87bc04597a8fbc38393c997
 2021-02-16 09:11:30 -08:00
Lucas Hosseini 0336293fec Update INSTALL.md. (#1686) 
Summary:
Add detailed information about installing/building/testing.

Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1686

Reviewed By: mdouze

Differential Revision: D26453860

Pulled By: beauby

fbshipit-source-id: a64f1ad46648d5576911459e833699ea37819c9d
 2021-02-16 06:52:56 -08:00
Lucas Hosseini 6f271490e8 Add CHANGELOG.md. (#1688) 
Summary:
The file follows the format described in
https://keepachangelog.com/en/1.0.0/.

Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1688

Reviewed By: mdouze

Differential Revision: D26454197

Pulled By: beauby

fbshipit-source-id: 16bafed43897479c7e87fae202b08e95107c6658
 2021-02-16 06:31:22 -08:00
Lucas Hosseini 08a0ce72a2 Fix nightly build for CUDA 11. (#1675) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1675

Reviewed By: mdouze

Differential Revision: D26338704

Pulled By: beauby

fbshipit-source-id: f440bbd05d6dbc09280e4f3631e4a9af99bde5f5
 2021-02-09 07:44:27 -08:00
Lucas Hosseini f5a8c29c57 Parameterize CUDA_ARCHS in packaging jobs. (#1671) 
Summary:
This will allow us to support compute capabilities 8.0 and 8.6 (for
Ampere devices) with CUDA 11.

Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1671

Reviewed By: mdouze

Differential Revision: D26338700

Pulled By: beauby

fbshipit-source-id: f023e7a37504d79ab78a45319e5a9cb825e7604a
 2021-02-09 07:37:51 -08:00
Lucas Hosseini 7c2d2388a4 Bump version to 1.7.0. (#1652) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1652

Reviewed By: mdouze

Differential Revision: D26077948

Pulled By: beauby

fbshipit-source-id: 599ee61edd2425250948577cb55d145d9179ab25
 2021-01-27 03:37:26 -08:00
Lucas Hosseini d494251b5d Increase no-output timeout for Linux GPU nightlies build. (#1605) 
Summary:
Since https://github.com/facebookresearch/faiss/issues/1566, the build for GPU seems to take significantly longer, causing GPU nightly builds to timeout.

Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1605

Reviewed By: mdouze

Differential Revision: D25780754

Pulled By: beauby

fbshipit-source-id: 879fcb55550711dd21030a640eed9cc1ee820fba
 2021-01-05 05:04:06 -08:00
Lucas Hosseini 4774951982 GitHub actions hooks for GitHub pages docs website. (#1599) 
Summary:
These hooks, along with the creation of the `gh-pages` branch with a Sphinx-powered website ([preview](https://beauby.github.io/faiss/)) will ensure automatic rebuild of the C++ API (doxygen) docs upon modification on `master`.
Moreover,  direct changes to the `gh-pages` branch will trigger a rebuild of the website as well.

Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1599

Reviewed By: wickedfoo

Differential Revision: D25723322

Pulled By: beauby

fbshipit-source-id: fafeed64b393dce8c569f9fd1f5bc3b004706589
 2020-12-29 13:46:54 -08:00
Lucas Hosseini bab6db84e0 Make pytorch available in CircleCI. (#1486) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1486

Reviewed By: wickedfoo

Differential Revision: D24493486

Pulled By: beauby

fbshipit-source-id: 00156213061503ff593b2e9ede062850b23527a9
 2020-10-22 21:10:32 -07:00
Lucas Hosseini 7891094da6 Add nightly packages for GPU. (#1485) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1485

Test Plan: Imported from OSS

Reviewed By: wickedfoo

Differential Revision: D24492171

Pulled By: beauby

fbshipit-source-id: 20fbcbdd50ab30e110e41b34e0c07d88432b1422
 2020-10-22 19:47:13 -07:00
Lucas Hosseini 0b365fa6d8 Add docker image for CUDA 10.1. (#1477) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1477

Test Plan: Imported from OSS

Reviewed By: wickedfoo

Differential Revision: D24492173

Pulled By: beauby

fbshipit-source-id: 5247accb2dc31bb125f9b06fb2275346b2e6465f
 2020-10-22 19:47:13 -07:00
Lucas Hosseini 616dc44e1e Update conda package for faiss-gpu. (#1476) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1476

Test Plan: Imported from OSS

Reviewed By: wickedfoo

Differential Revision: D24492172

Pulled By: beauby

fbshipit-source-id: 63497b54d8aed10d45ebc4ed7659dd1d18b36edf
 2020-10-22 19:47:13 -07:00
Lucas Hosseini 64c13cdda3 Run python gpu tests. (#1479) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1479

Reviewed By: mdouze

Differential Revision: D24413984

Pulled By: beauby

fbshipit-source-id: 006343c996a278df1d9fc70e11283d31d63a0330
 2020-10-22 09:56:30 -07:00
Lucas Hosseini 89187fee3c Fix CMake build on GPU. (#1475) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1475

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D24393544

Pulled By: beauby

fbshipit-source-id: 4776cb75dc11e5bb4bb4417ee44f0c794084c301
 2020-10-19 16:56:17 -07:00
Lucas Hosseini 3ac3ca0fab Update conda packages build. (#1422) 
Summary:
This PR paves the way for nightly builds.

+ Get rid of cmake 3.17 manual install as cmake 3.18 is now available
in conda.
+ Update docker files for conda packages.
+ Specify CUDA architectures via CMake's `CMAKE_CUDA_ARCHITECTURES`.

Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1422

Reviewed By: mdouze

Differential Revision: D23870447

Pulled By: beauby

fbshipit-source-id: 40ae7517e83356443a007a43261713e7e3a140d4
 2020-09-23 10:18:25 -07:00
Lucas Hosseini bf7e5d1b2f Bundle all files from contrib/ in python extension. (#1386) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1386

Reviewed By: mdouze

Differential Revision: D23416997

Pulled By: beauby

fbshipit-source-id: 9fc64d709046f65f49268cf2b9908dbd853d108d
 2020-08-31 01:11:59 -07:00
Lucas Hosseini 3a9eb87af2 Windows CI + conda packaging. (#1377) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1377

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23314728

Pulled By: beauby

fbshipit-source-id: fb74b1e832233aeeea47f3acdd606c6be65c143f
 2020-08-25 16:58:25 -07:00
Lucas Hosseini bbdbc41bdf Fix dynamic size arrays. (#1376) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1376

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23314734

Pulled By: beauby

fbshipit-source-id: 0ea33812e2f8b9044830989ea8ba7607b5a1eb0c
 2020-08-25 16:58:25 -07:00
Lucas Hosseini 51ff90ac01 Add __PRETTY_FUNCTION__ polyfill. (#1375) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1375

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23314740

Pulled By: beauby

fbshipit-source-id: f11b6f9753981742be9181247a30b786cc5d0e81
 2020-08-25 16:58:25 -07:00
Lucas Hosseini 7c6a446bf5 Avoid building OnDiskInvertedLists on Windows. (#1374) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1374

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23314729

Pulled By: beauby

fbshipit-source-id: 5ad7fa3ed830b17a5be66fb2995dd94e079d8507
 2020-08-25 16:58:24 -07:00
Lucas Hosseini e520756b1c Export static/extern globals. (#1373) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1373

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23314736

Pulled By: beauby

fbshipit-source-id: 321d1fe510d9cb9fbb08b7b089a0ea420e215fa8
 2020-08-25 16:58:24 -07:00
Lucas Hosseini 6d3c49bad6 Fix target export for Windows. (#1372) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1372

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23314733

Pulled By: beauby

fbshipit-source-id: 1042428ac35ec4e6f68879001af9f2d8fe880a7e
 2020-08-25 16:58:24 -07:00
Lucas Hosseini b9cfa46c92 Fix guard clause on get_mem_usage_kb(). (#1371) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1371

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23314741

Pulled By: beauby

fbshipit-source-id: f64e80fbb24bac25134a3d619845839274db898b
 2020-08-25 16:58:24 -07:00
Lucas Hosseini 2450f5ee4c Fix swig build on Windows. (#1370) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1370

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23314739

Pulled By: beauby

fbshipit-source-id: 1a48e6bc14fe24b7fbffbbc60f40997d6441e46e
 2020-08-25 16:58:24 -07:00
Lucas Hosseini 2ccecbcd7e Windows implementation of getmillisecs(). (#1369) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1369

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23314738

Pulled By: beauby

fbshipit-source-id: 72590eea929edcd8bd133c65265778b6cf6574a9
 2020-08-25 16:58:24 -07:00
Lucas Hosseini e3044c407e Add __builtin_ctzll/__builtin_clzll polyfills. (#1368) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1368

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23314730

Pulled By: beauby

fbshipit-source-id: ccddb11ef1ce32e0183497640454cfc176edba01
 2020-08-25 16:58:24 -07:00
Lucas Hosseini 86ac808fd3 Add __builtin_popcountl polyfill. (#1367) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1367

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23314742

Pulled By: beauby

fbshipit-source-id: f15ae3a06d5cc55d4578443bc56f1af520bbc715
 2020-08-25 16:58:24 -07:00
Lucas Hosseini 95216f91f4 Add strtok_r polyfill. (#1366) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1366

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23314735

Pulled By: beauby

fbshipit-source-id: ee0f9c1fb14d80da7820b2cd614a24c01f87370e
 2020-08-25 16:58:24 -07:00
Lucas Hosseini dc4d3c2013 Fix setup.py for Windows. (#1365) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1365

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23314737

Pulled By: beauby

fbshipit-source-id: e9ba69c5559f1e22855912ef301a060e27d2193d
 2020-08-25 16:58:24 -07:00
Lucas Hosseini e5d2defaae Disable contrib tests for python2. (#1364) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1364

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23314732

Pulled By: beauby

fbshipit-source-id: 788465c353bbc65947a6c766e8509f35f35e4134
 2020-08-25 16:58:24 -07:00
Lucas Hosseini c689bd010c Update conda packaging. (#1363) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1363

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23314731

Pulled By: beauby

fbshipit-source-id: b57a66cf5c44788837ee379fbb7f73adbdbf1274
 2020-08-25 16:58:24 -07:00
Lucas Hosseini 2434e91ef7 Fix leaking fd in test_io. (#1362) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1362

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23311998

Pulled By: beauby

fbshipit-source-id: 9de47f9650eee2a07d302ac1753d60d0d00c2f0f
 2020-08-24 23:53:27 -07:00
Lucas Hosseini 00dfdd3085 Fix format specifier in python_callbacks. (#1361) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1361

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23312001

Pulled By: beauby

fbshipit-source-id: 006536827463e14eb5747cb464e41163c0cf6490
 2020-08-24 23:53:27 -07:00
Lucas Hosseini ef28350b4b Move definition of inner_product_to_L2sqr() to distances.cpp. (#1359) 
Summary:
Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1359

The declaration is in distances.h, which utils.cpp does not include,
confusing the linker on Windows.

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23311999

Pulled By: beauby

fbshipit-source-id: 6ebf26248a4376abc9dd90996e5dc43fa343e0b4
 2020-08-24 23:53:27 -07:00
Lucas Hosseini b23b2f66df Fix VectorDistance initialization. (#1358) 
Summary:
Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1358

The MSVC compiler gets confused by aggregate initialization with parentheses.

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23312003

Pulled By: beauby

fbshipit-source-id: 9ceb10ac84fd4aee19bf6352298b24def95f1493
 2020-08-24 23:53:27 -07:00
Lucas Hosseini 1cc5c6d095 Remove extraneous unix header include. (#1356) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1356

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23312000

Pulled By: beauby

fbshipit-source-id: b54250df7f5a8b69f707546649024d82adefd745
 2020-08-24 23:53:27 -07:00
Lucas Hosseini 39d7a33840 Make OOMException test Linux-only. (#1354) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1354

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23292455

Pulled By: beauby

fbshipit-source-id: 50b096fd869724ef8e87f697887e8617522324e3
 2020-08-24 06:46:52 -07:00
Lucas Hosseini 24c4460dd2 Avoid leaking file descriptors in python tests. (#1353) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1353

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23292456

Pulled By: beauby

fbshipit-source-id: 44458eb16d037883ff39827accf5edddb1b1bb89
 2020-08-24 06:46:52 -07:00
Lucas Hosseini e0423f7fcd Fix long used as uint64_t in lattice_Zn. (#1352) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1352

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23292457

Pulled By: beauby

fbshipit-source-id: 58720b750ec6c06068be5fb0844aa581725efc4a
 2020-08-24 06:46:52 -07:00
Lucas Hosseini 10bddff11c Fix unclosed thread pool. (#1351) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1351

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23292458

Pulled By: beauby

fbshipit-source-id: 5f134178d2991d90bb5bbd50414af6febafb141d
 2020-08-24 06:46:52 -07:00
Lucas Hosseini c37e71456b Get rid of non-portable drand48. (#1349) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1349

Reviewed By: mdouze

Differential Revision: D23289393

Pulled By: beauby

fbshipit-source-id: a626bbf252ced4ae01abbc3dce4be50d9e628728
 2020-08-24 00:42:21 -07:00
Lucas Hosseini 9a7f2b9bd0 Avoid OpenMP 4.0 custom reduction. (#1344) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1344

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23234970

Pulled By: beauby

fbshipit-source-id: 38aad08c0c856be425cea163bef7d29715a4cd39
 2020-08-20 10:45:28 -07:00
Lucas Hosseini b35dec740d Fix unsigned OpenMP loop indices (disallowed in OpenMP 2). (#1343) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1343

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23234967

Pulled By: beauby

fbshipit-source-id: e4f1541c4460052a9cbccc3a9365206bfa330694
 2020-08-20 10:45:28 -07:00
Lucas Hosseini 91ab745da8 Fix long literals used as 64 bit. (#1342) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1342

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23234963

Pulled By: beauby

fbshipit-source-id: 1c28f9c88777b31c1e2f432966c51f2986746965
 2020-08-20 10:45:28 -07:00
Lucas Hosseini 7cc320e438 Replace finite() with std::isfinite(). (#1341) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1341

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23234968

Pulled By: beauby

fbshipit-source-id: f7ba7bd473e05f2ba4d0ca555bc78965f5aa3fd1
 2020-08-20 10:45:27 -07:00
Lucas Hosseini 7b615ed5d9 Replace bzero (deprecated in POSIX 2001) with memset. (#1340) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1340

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23234969

Pulled By: beauby

fbshipit-source-id: 0e016c3502cd2e97eae2c2a010525e08f32ec5e2
 2020-08-20 10:45:27 -07:00
Lucas Hosseini 7c1c7f81d2 Fix division by zero. (#1339) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1339

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23234966

Pulled By: beauby

fbshipit-source-id: 43142bbf2e30ce69dd15dfc1818d3e3079c7ec48
 2020-08-20 10:45:27 -07:00
Lucas Hosseini a97ebeeabd Fix format specifiers for size_t/idx_t. (#1338) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1338

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23234964

Pulled By: beauby

fbshipit-source-id: 2222d90d8ca3f9a6ac3a9e624e7ec87072da3a25
 2020-08-20 10:45:27 -07:00
Lucas Hosseini 8438062b88 Add missing algorithm header. (#1337) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1337

Test Plan: Imported from OSS

Reviewed By: mdouze

Differential Revision: D23234965

Pulled By: beauby

fbshipit-source-id: 1b4af90fdda37d4554f9f8774ac4559f481197a0
 2020-08-20 10:45:27 -07:00
Lucas Hosseini b7b261cad1 Move from TravisCI to CircleCI (#1315) 
Summary:
Depends on https://github.com/facebookresearch/faiss/issues/1313.

Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1315

Reviewed By: mdouze

Differential Revision: D23148557

Pulled By: beauby

fbshipit-source-id: 0a35f17d22aa04db6bd1c16cfc5ff8eee28f1f74
 2020-08-15 04:00:51 -07:00
Lucas Hosseini a8e4c5e2d5 Move build to CMake (#1313) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1313

Reviewed By: mdouze

Differential Revision: D22948267

Pulled By: beauby

fbshipit-source-id: ec16fa0342f37672d46fb7886ecc55c7996011c4
 2020-08-14 15:03:10 -07:00
Lucas Hosseini 569c855ed0 Fix guard clauses for SSE3. (#1325) 
Summary: Pull Request resolved: https://github.com/facebookresearch/faiss/pull/1325

Reviewed By: mdouze

Differential Revision: D23104964

Pulled By: beauby

fbshipit-source-id: 04705f1695e65682748b6308fd5d3e217a4af75a
 2020-08-13 10:10:19 -07:00
Lucas Hosseini ac74f576f7 fbshipit-source-id: 4f3cfa59471d548af93fe118d1b73d45bc648edf 2020-08-04 12:00:38 -07:00
Lucas Hosseini 31f27bd15a ShipIt sync. 
fbshipit-source-id: f8ed169dc1d95b3364f4a158efb9fae531a5901d
 2020-08-04 09:57:43 -07:00
Lucas Hosseini a8118acbc5 Facebook sync (May 2019) + relicense (#838) 
Changelog:

- changed license: BSD+Patents -> MIT
- propagates exceptions raised in sub-indexes of IndexShards and IndexReplicas
- support for searching several inverted lists in parallel (parallel_mode != 0)
- better support for PQ codes where nbit != 8 or 16
- IVFSpectralHash implementation: spectral hash codes inside an IVF
- 6-bit per component scalar quantizer (4 and 8 bit were already supported)
- combinations of inverted lists: HStackInvertedLists and VStackInvertedLists
- configurable number of threads for OnDiskInvertedLists prefetching (including 0=no prefetch)
- more test and demo code compatible with Python 3 (print with parentheses)
- refactored benchmark code: data loading is now in a single file
 2019-05-28 16:17:22 +02:00
Lucas Hosseini 012954ebbf Fix HNSW.fill_with_random_links. (#801) 2019-04-23 16:52:39 +02:00
Lucas Hosseini e811fecac6 Make clean target bourne shell compatible. (#783) 2019-04-10 15:54:57 +02:00
Lucas Hosseini 1e3e7f4262 Make Makefile bourne shell compliant. (#782) 2019-04-10 14:55:30 +02:00
Lucas Hosseini 5555ae7f88 Configure install paths in Dockerfile. (#772) 2019-04-07 23:22:43 +02:00
Lucas Hosseini 7f5b22b0ff Add conda packages metadata + tests. (#769) 
+ Add conda packages metadata (now building Faiss using conda's toolchain);
+ add Dockerfile for building conda packages (for all CUDA versions);
+ add working Dockerfile building faiss on Centos7;
+ simplify GPU build;
+ avoid falling back to CPU-only version (python);
+ simplify TravisCI config;
+ update INSTALL.md;
+ add configure flag for specifying target architectures (--with-cuda-arch);
+ fix Makefile for gpu tests;
+ fix various Makefile issues;
+ remove stale file (gpu/utils/DeviceUtils.cpp).
 2019-04-05 11:50:39 +02:00
Lucas Hosseini 6c1cb3cd5c Fix ivfpq demo. (#763) 
Makes sense.
 2019-04-03 11:24:33 +02:00
Lucas Hosseini afe0fdc161 Facebook sync (Mar 2019) (#756) 
Facebook sync (Mar 2019)

- MatrixStats object
- option to round coordinates during k-means optimization
- alternative option for search in HNSW
- moved stats and imbalance_factor of IndexIVF to InvertedLists object
- range search for IVFScalarQuantizer
- direct unit8 codec in ScalarQuantizer
- renamed IndexProxy to IndexReplicas and moved to main Faiss
- better support for PQ code assignment with external index
- support for IMI2x16 (4B virtual centroids!)
- support for k = 2048 search on GPU (instead of 1024)
- most CUDA mem alloc failures throw exceptions instead of terminating on an assertion
- support for renaming an ondisk invertedlists
- interrupt computations with ctrl-C in python
 2019-03-29 16:32:28 +01:00
Lucas Hosseini 4e8d324922 Fix Travis build on OSX. (#692) 2019-01-15 21:47:02 +01:00
Lucas Hosseini f417a53628 Fix CI tests (#687) 
* Fix test_transfer_invlists.cpp

* Fix relative imports.

* Fix test_index_accuracy.py.

* Use default OSX version.

* Allow osx gcc6 build to fail.
 2019-01-08 17:52:36 +01:00
Lucas Hosseini ac7005b6ef Remove CMake. (#645) 2018-12-23 18:45:16 +01:00
Lucas Hosseini 4bcb5b3fe0 Update README.md 2018-12-19 18:08:20 +01:00
Lucas Hosseini 323dbf3be3 Facebook sync (Dec 2018). (#660) 
* Add GpuIndexBinaryFlat
* Add IndexBinaryHNSW
 2018-12-19 17:48:35 +01:00
Lucas Hosseini 76bec0b500 Facebook sync (#573) 
Features:

- automatic tracking of C++ references in Python
- non-intel platforms supported -- some functions optimized for ARM
- override nprobe for concurrent searches
- support for floating-point quantizers in binary indexes
Bug fixes:

- no more segfaults in python (I know it's the same as the first feature but it's important!)
- fix GpuIndexIVFFlat issues for float32 with 64 / 128 dims
- fix sharding of flat indexes on GPU with index_cpu_to_gpu_multiple
 2018-08-30 19:38:50 +02:00
Lucas Hosseini 2dc30e14cf Add support for Volta GPUs. (#517) 2018-07-10 19:37:57 +02:00
Lucas Hosseini 3c70207da5 Fix linking of python GPU faiss. (#510) 2018-07-06 17:31:25 +02:00
Lucas Hosseini 5d29b3624c Use multi-threaded MKL by default (#509) 
* Configure script use threaded MKL instead of sequential.

* Do not link against GNU OpenMP when linking against Intel OpenMP.
 2018-07-06 17:26:37 +02:00
Lucas Hosseini 6880286ea0 Facebook sync (#504) 
* Facebook sync

* Update swig wrappers.

* Fix comment.
 2018-07-06 14:12:11 +02:00
Lucas Hosseini f841bbab09 Fix linking order for misc/test_blas in Makefile. (#489) 2018-06-13 11:49:02 +02:00
Lucas Hosseini 1fe2872013 Rename gpu/tests to gpu/test (#481) 
thanks.
 2018-06-06 14:08:49 +02:00
Lucas Hosseini 21fbc56dfd Python install (#469) 
* add a working setup.py

* Rename setup.py to python/setup.py

* Fix paths in setup.py

* Use relative imports for python3 compatibility.

* Add python/install Makefile target.

* Fix test target in Makefile.
 2018-06-06 14:06:24 +02:00
Lucas Hosseini 6e40d6689f Move python tests back together with C++ tests. (#479) 2018-06-04 12:20:44 +02:00
Lucas Hosseini 57e973eae9 Fix GPU tests Makefile. (#473) 2018-06-03 20:43:02 +02:00
Lucas Hosseini 7f996bd9df Fix failing tests on OSX (#467) 2018-06-02 13:48:11 +02:00
Lucas Hosseini d1bbee28d7 Add TravisCI config. (#457) 
* Add TravisCI config.
 2018-06-02 13:15:18 +02:00
Lucas Hosseini cf18101f6d Refactor makefiles and add configure script (#466) 
* Refactors Makefiles and add configure script.

* Give MKL higher priority in configure script.

* Clean up Linux example makefile.inc.

* Cleanup makefile.inc examples.

* Fix python clean Makefile target.

* Regen swig wrappers.

* Remove useless CUDAFLAGS variable.

* Fix python linking flags.

* Separate compile and link phase in python makefile.

* Add macro to look for swig.

* Add CUDA check in configure script.

* Cleanup make depend targets.

* Cleanup CUDA flags.

* Fix linking flags.

* Fix python GPU linking.

* Remove useless flags from python gpu module linking.

* Add check for cuda libs.

* Cleanup GPU targets.

* Clean up test target.

* Add cpu/gpu targets to python makefile.

* Clean up tutorial Makefile.

* Remove stale OS var from example makefiles.

* Clean up cuda example flags.
 2018-06-02 08:35:30 +02:00
Lucas Hosseini dcd83f95b9 Fix race condition in OnDiskInvertedlists. (#464) 2018-05-30 16:25:24 +02:00
Lucas Hosseini 1ae7494491 Add (un)install Makefile targets for CPU version. (#344) 
* Remove useless LIBNAME macro in Makefile.

* Add installdirs, install, and uninstall Makefile targets.

* Fix merge.
 2018-04-05 11:45:33 +02:00