c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
2,753 Commits 171 Branches 49 Tags
1ab25c49d351703c79d7ca03025488b2f2492e8a
Commit Graph
57 Commits
Author SHA1 Message Date
Aymeric Augustin 343c094f21 Run examples separately from tests. 
This optimizes the total run time of the Circle CI test suite.
 2019-12-21 08:43:19 +01:00
Aymeric Augustin 80caf79d07 Prevent excessive parallelism in PyTorch. 
We're already using as many processes in parallel as we have CPU cores.
Furthermore, the number of core may be incorrectly calculated as 36
(we've seen this in pytest-xdist) which make compound the problem.

PyTorch performance craters without this.
 2019-12-21 08:43:19 +01:00
Aymeric Augustin bb3bfa2d29 Distribute tests from the same file to the same worker. 
This should prevent two issues:

- hitting API rate limits for tests that hit the HF API
- multiplying the cost of expensive test setups
 2019-12-21 08:43:19 +01:00
Aymeric Augustin 29cbab98f0 Parallelize tests on Circle CI. 
Set the number of CPUs manually based on the Circle CI resource class,
or else we're getting 36 CPUs, which is far too much (perhaps that's
the underlying hardware and not what Circle CI allocates to us).

Don't parallelize the custom tokenizers tests because they take less
than one second to run and parallelization actually makes them slower.
 2019-12-21 08:43:19 +01:00
thomwolf 15dda5ea32 remove python 2 tests for circle-ci cc @aaugustin @julien-c @LysandreJik 2019-12-20 13:20:41 +01:00
thomwolf e4baa68ddb tick-tock cc @julien-c 2019-12-19 20:37:26 +01:00
Thomas Wolf d5712f7cac Merge branch 'master' into check-link-validity 2019-12-12 08:00:51 +01:00
Julien Chaumond 371c5ddfad Py2 tests for Lysandre 2019-12-11 18:32:27 -05:00
Julien Chaumond 5505cf7014 Run tests on Py2 too, for Lysandre 2019-12-11 18:32:27 -05:00
Julien Chaumond 9cb97c0c0f Actually run the tests 2019-12-11 18:32:27 -05:00
Julien Chaumond 95854c4a2f Actually run the tests 2019-12-11 18:32:27 -05:00
Julien Chaumond d2100428d3 Update to new test infra and only run conditionally 2019-12-11 18:32:27 -05:00
Masatoshi Suzuki 597ba7feb3 Support testing Japanese BERT tokenizers 2019-12-11 18:32:27 -05:00
Rémi Louf f230d91b43 check the validity of links 
We add a script and a CI workflow to check that all download links
present in the source code are valid.
 2019-12-06 09:41:28 +01:00
Lysandre 45d767297a Updated v2.2.0 doc 2019-11-27 10:12:20 -05:00
Lysandre cc7968227e Updated v2.2.0 doc 2019-11-26 15:52:25 -05:00
Lysandre 44b82c777f Updated v2.2.0 doc 2019-11-26 15:15:11 -05:00
Lysandre 7c6000e412 Updated v2.2.0 doc 2019-11-26 14:55:29 -05:00
Lysandre ae98d45991 Release: v2.2.0 2019-11-26 14:12:44 -05:00
Lysandre be7f2aacce [CI][DOC] Don't rebuild if folder exists - Correct directory. 2019-11-14 14:54:44 -05:00
Lysandre 8f8d69716a [CI][DOC] Don't rebuild if folder exists. 2019-11-14 14:48:21 -05:00
Lysandre Debut 6e85bccafc Fixed typo 2019-10-22 18:07:01 -04:00
Lysandre fbcc5ff9fb Change branch to master 2019-10-22 18:01:10 -04:00
Lysandre 69eba0ab19 Edit script path 2019-10-22 17:53:52 -04:00
Lysandre bc3e57d551 Multi version doc deployment 2019-10-22 17:51:30 -04:00
thomwolf 2a4fef837a move Circle-CI from TF2-rc0 to official TF2 2019-10-10 15:57:35 +02:00
Julien ChaumondandLysandre Debut 22d2fded2c [docs] Fix doc auto-deploy 
Co-Authored-By: Lysandre Debut <lysandre.debut@reseau.eseo.fr>
 2019-09-26 18:22:45 -04:00
thomwolf 31c23bd5ee [BIG] pytorch-transformers => transformers 2019-09-26 10:15:53 +02:00
thomwolf 0f091062d4 Merge branch 'glue-example' into tf2 2019-09-25 10:21:52 +02:00
thomwolf 2167e366ba update circleCi 2019-09-24 13:27:45 +02:00
thomwolf e9a103c17a bidirectional conversion TF <=> PT - extended tests 2019-09-24 13:25:50 +02:00
LysandreJik 11ac4b9555 [CI] Symbolic link for documentation 2019-09-11 10:13:44 +02:00
thomwolf e30579f764 no pytest version checking 2019-09-08 15:02:06 +03:00
thomwolf 518307dfcd test suite independent of framework 2019-09-08 15:02:06 +03:00
thomwolf 9d0a11a68c update dependencies and circle-ci 2019-09-08 15:02:06 +03:00
thomwolf ad0ab9afe9 fix test when tf is not here 2019-09-08 15:02:06 +03:00
LysandreJik 3fbf301bba [CI] Updated resource size for python 3 tests 2019-09-02 12:35:14 -04:00
Julien Chaumond 0fd0b674e6 [ci] legible output [skip ci] 2019-08-30 20:36:26 -04:00
Julien Chaumond b65a994f59 [ci] decrease parallelism to increase success prob 2019-08-30 20:33:16 -04:00
LysandreJik e7fba4bef5 Documentation auto-deploy 2019-08-29 12:14:29 -04:00
thomwolf 7322c314a6 remove python2 testing for examples 2019-07-12 14:24:08 +02:00
thomwolf 273617b86d update config - fix gpt/gpt-2 from pretrained 2019-07-11 22:45:03 +02:00
thomwolf 6b13f4cb3a update circle-ci 2019-07-11 22:36:35 +02:00
thomwolf 2b644785f0 add tests on examples and large circle ci config 2019-07-11 22:31:50 +02:00
LysandreJik 3f56ad5aff Updated CircleCI's config.yml to use a large resource class. 2019-07-09 18:50:59 -04:00
thomwolf a4f980547f remove circle ci parallelism 2019-07-05 12:31:34 +02:00
thomwolf 0bab55d5d5 [BIG] name change 2019-07-05 11:55:36 +02:00
thomwolf cf86d23eff parallelism in circlci 2019-07-04 17:02:21 +02:00
thomwolf 99ae5ab883 update config tests and circle-ci 2019-07-02 12:40:39 +02:00
thomwolf 411981a080 remove slow circle-ci 2019-06-20 08:54:18 +02:00