enable activation checkpointing
#10
by smangrul - opened
This PR is meant to enable activation checkpointing
model = AutoModelForCausalLM.from_pretrained("microsoft/phi-2", checkpointing=True)
It gives me an Error "TypeError: PhiForCausalLM.init() got an unexpected keyword argument 'checkpointing'"
Hello @smangrul and @rungao2001 !
This will be updated once we integrate with the Phi implementation in HF.
Best regards,
Gustavo.
gugarosa changed pull request status to closed