eryk-dsai 5019f59724 fix: more robust check whether the HF model is quantized (#11891) ...

Removes the check of `model.is_quantized` and adds more robust way of
checking for 4bit and 8bit quantization in the `huggingface_pipeline.py`
script. I had to make the original change on the outdated version of
`transformers`, because the models had this property before. Seems
redundant now.

Fixes: https://github.com/langchain-ai/langchain/issues/11809 and
https://github.com/langchain-ai/langchain/issues/11759

2023-10-16 16:54:20 -07:00

..

experimental

bump 315 (#11850)

2023-10-16 00:50:54 -07:00

langchain

fix: more robust check whether the HF model is quantized (#11891)

2023-10-16 16:54:20 -07:00