c-my/transformers
1
0 Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
3,331 Commits 171 Branches 49 Tags
2c7749784c2581cff57fdfbecfc16fb4a11a45e0
Commit Graph
3331 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
Julien Chaumond 42f08e596f [examples] rename run_lm_finetuning to run_language_modeling 2020-02-07 09:15:28 -05:00
Julien Chaumond 4f7bdb0958 [examples] Fix broken markdown 2020-02-07 09:15:28 -05:00
thomwolf c6c5c3fd4e style and quality 2020-02-07 08:58:06 +01:00
thomwolf 961c69776f @julien-c proposal for TF/PT compat in hf_buckets 2020-02-07 08:53:17 +01:00
thomwolf d311f87bca cleanup 2020-02-07 00:05:28 +01:00
thomwolf 7d99e05f76 file_cache has options to extract archives 2020-02-07 00:03:12 +01:00
dchurchwell 2c12464a20 Changed vocabulary save function. Variable name was inconsistent, causing an error to be thrown when passing a file name instead of a directory. 2020-02-06 16:40:07 -05:00
Peter Izsak 6fc3d34abd Fix multi-gpu evaluation in run_glue.py 2020-02-06 16:38:55 -05:00
Julien Chaumond 7748cbbe7d Oopsie 2020-02-06 15:30:02 -05:00
Julien Chaumond 432c12521e [docs] Add menu w/ links to other pages on hf.co 2020-02-06 15:30:02 -05:00
Clement c069932f5d Add contributors snapshot 
powered by https://github.com/sourcerer-io/hall-of-fame
 2020-02-06 15:25:47 -05:00
Lysandre Debut 33d3072e1c Arxiv README (#2747) 
* Arxiv README

* ArXiv-NLP readme
 2020-02-05 15:26:28 -05:00
Julien Chaumond eae8ee0389 [doc] model sharing: mention README.md + tweaks 
cc @lysandrejik @thomwolf
 2020-02-05 14:20:03 -05:00
James Betker 6bb6a01765 Fix GPT2 config set to trainable 
This prevents the model from being saved, and who knows
what else.
 2020-02-05 13:55:41 -05:00
Julien ChaumondandLysandre Debut ada24def22 [run_lm_finetuning] Tweak fix for non-long tensor, close #2728 
see 1ebfeb7946 and #2728

Co-Authored-By: Lysandre Debut <lysandre.debut@reseau.eseo.fr>
 2020-02-05 12:49:18 -05:00
Lysandre 2184f87003 RoBERTa TensorFlow Tests 2020-02-04 18:05:35 -05:00
Lysandre e615269cb8 Correct slow test 2020-02-04 18:05:35 -05:00
Lysandre 5f96ebc0be Style 2020-02-04 18:05:35 -05:00
Lysandre 950c6a4f09 Flaubert PyTorch tests 2020-02-04 18:05:35 -05:00
Lysandre d28b81dc29 RoBERTa Pytorch tests 2020-02-04 18:05:35 -05:00
Yuval Pinter d1ab1fab1b pass langs parameter to certain XLM models (#2734) 
* pass langs parameter to certain XLM models

Adding an argument that specifies the language the SQuAD dataset is in so language-sensitive XLMs (e.g. `xlm-mlm-tlm-xnli15-1024`) don't default to language `0`.
Allows resolution of issue #1799 .

* fixing from `make style`

* fixing style (again)
 2020-02-04 17:12:42 -05:00
sshleifer 9e5b549b4d fix default getattr 2020-02-04 16:38:52 -05:00
sshleifer 25848a6094 double quotes 2020-02-04 16:38:52 -05:00
sshleifer cbcb83f21d minor cleanup of test_attention_outputs 2020-02-04 16:38:52 -05:00
Lysandre 3bf5417258 Revert erroneous fix 2020-02-04 16:31:07 -05:00
Lysandre 1ebfeb7946 Cast to long when masking tokens 2020-02-04 15:56:16 -05:00
Lysandre 9c67196b83 Update quickstart 2020-02-04 11:11:37 -05:00
Lysandre 90ab15cb7a Remove redundant hidden states 2020-02-04 10:59:32 -05:00
Julien Chaumond 9a50828b5c Pipelines: fix crash when modelcard is None 
cc @mfuntowicz does this seem correct?
 2020-02-03 17:53:39 -05:00
Lysandre 6c1b23554f Sample instead of greedy decoding by default in generate 2020-02-03 17:23:53 -05:00
Lysandre 239dd23f64 [Follow up 213] 
Masked indices should have -1 and not -100. Updating documentation + scripts that were forgotten
 2020-02-03 16:08:05 -05:00
Martin Malmsten 522c5b5533 Added README.md to Swedish BERT models from National Library of Sweden 2020-02-03 09:09:34 -05:00
Julien Plu 9329e59700 Add READMEs to Tensorflow versions of CamemBERT and XLM-RoBERTa 2020-02-03 09:04:34 -05:00
Antonio Carlos Falcão Petri 2ba147ecff Fix typo in examples/utils_ner.py 
"%s-%d".format() -> "{}-{}".format()
 2020-02-01 11:10:57 -05:00
Bram Vanroy 9773e5e0d9 CLI script to gather environment info (#2699) 
* add "info" command to CLI

As a convenience, add the info directive to CLI. Running `python transformers-cli info` will return a string containing the transformers version, platform, python version, PT/TF version and GPU support

* Swap f-strings for .format

Still supporting 3.5 so can't use f-strings (sad face)

* Add reference in issue to CLI

* Add the expected fields to issue template

This way, people can still add the information manually if they want. (Though I fear they'll just ignore it.)

* Remove heading from output

* black-ify

* order of imports

Should ensure isort test passes

* use is_X_available over import..pass

* style

* fix copy-paste bug

* Rename command info -> env

Also adds the command to CONTRIBUTING.md in "Did you find a bug" section
 2020-02-01 10:38:14 -05:00
Julien ChaumondandStefan Schweter ddb6f9476b [model_cards] dbmdz models 
Co-Authored-By: Stefan Schweter <stefan-it@users.noreply.github.com>
 2020-01-31 18:39:09 -05:00
Julien ChaumondandHenrykBorzymowski 6636826f04 [model_cards] Multilingual + Dutch SQuAD2.0 
Co-Authored-By: HenrykBorzymowski <henrykborzymowski@users.noreply.github.com>
 2020-01-31 18:39:09 -05:00
Julien ChaumondLoreto ParisiSimone Francia
 		98dadc98e1 [model_cards] UmBERTo 
Co-Authored-By: Loreto Parisi <loretoparisi@gmail.com>
Co-Authored-By: Simone Francia <francia.simone1@gmail.com>
 2020-01-31 18:39:09 -05:00
Julien Chaumond d6fc34b459 [model_cards] add mine 2020-01-31 18:39:09 -05:00
Lysandre d426b58b9e Patch: v2.4.1 v2.4.1 2020-01-31 14:55:33 -05:00
Lysandre 1e82cd8457 Flaubert auto tokenizer + tests 
cc @julien-c
 2020-01-31 14:16:52 -05:00
Lysandre d18d47be67 run_generation style 2020-01-31 12:05:48 -05:00
Lysandre ff6f1492e8 FlauBERT load in AutoModel 
The FlauBERT configuration file inherits from XLMConfig, and is recognized as such when loading from AutoModels as the XLMConfig is checked before the FlaubertConfig.

Changing the order solves this problem, but a test should be added.
 2020-01-31 12:05:15 -05:00
Lysandre 7365f01d43 do_sample should be set to True in run_generation.py 2020-01-31 11:49:32 -05:00
Arnaud 3a21d6da6b Typo on markdown link in README.md 2020-01-31 10:58:49 -05:00
Lysandre 0aa40e9569 v2.4.0 documentation 2020-01-31 09:55:34 -05:00
Lysandre 8036ceb7c5 Update commands for pypi test 2020-01-31 09:48:15 -05:00
Lysandre 6664ea943d Release: v2.4.0 v2.4.0 2020-01-31 09:40:32 -05:00
Julien Chaumond 5a6b138b00 [Umberto] model shortcuts (#2661) 
* [Umberto] model shortcuts

cc @loretoparisi @simonefrancia

see #2485

* Ensure that tokenizers will be correctly configured
 2020-01-30 21:05:53 -05:00
Julien Chaumond 7fe294bf07 Hotfix: same handling of non-existent files as for config 2020-01-30 20:05:04 -05:00