transformers

2,405 Commits 171 Branches 49 Tags

2 Commits

Author	SHA1	Message	Date
Rostislav Nedelchev	76c0bc06d5	[XLNet] Changed post-processing of attention w.r.t to target_mapping Whenever target_mapping is provided to the input, XLNet outputs two different attention streams. Based on that the attention output would be on of the two: - a list of tensors (usual case for most transformers) - a list of 2-tuples of tensors, one tesor for each of attention streams Docs and unit-tests have been updated	2019-11-30 21:01:04 +01:00
Rostislav Nedelchev	b90791e950	fixed XLNet attenttion output for both attention streams	2019-11-30 15:57:51 +01:00

Author

SHA1

Message

Date

Rostislav Nedelchev

76c0bc06d5

[XLNet] Changed post-processing of attention w.r.t to target_mapping

Whenever target_mapping is provided to the input, XLNet outputs two different attention streams.
Based on that the attention output would be on of the two:
- a list of tensors (usual case for most transformers)
- a list of 2-tuples of tensors, one tesor for each of attention streams
Docs and unit-tests have been updated

2019-11-30 21:01:04 +01:00

Rostislav Nedelchev

b90791e950

fixed XLNet attenttion output for both attention streams

2019-11-30 15:57:51 +01:00