| // Copyright (c) Microsoft Corporation. | |
| // SPDX-License-Identifier: Apache-2.0 | |
| // DeepSpeed Team | |
| /* | |
| Copyright NVIDIA/apex | |
| This file is adapted from fused adam in NVIDIA/apex, commit a109f85 | |
| */ | |
| // Copyright (c) Microsoft Corporation. | |
| // SPDX-License-Identifier: Apache-2.0 | |
| // DeepSpeed Team | |
| /* | |
| Copyright NVIDIA/apex | |
| This file is adapted from fused adam in NVIDIA/apex, commit a109f85 | |
| */ | |