[FIXED] How to Run Pytorch Bert with AMD

Issue

github code: https://github.com/bellowman/Deep-Learning-Practice/blob/main/BioBert%20for%20Multi%20Label%20AMD.ipynb

Hello everyone,

I am a beginner with pytorch, tensorflow, and BERT. I have a machine at home with an AMD Ryzen 7 1800x and a Radeon RX 6600 video card.

I am trying to run a bioBERT model at home. I have trouble leveraging my model to use my AMD card. I posted my github notebook. I have troubles in cell 3 and 9.

1. First Question: In cell 3,I am trying to convert the bioBERT weight to PyTorch with transformmer-cli. I get the warning of "Could not load dynamic library 'cudart64_110.dll'". Does this affect performance later?
2. Second Question: In cell 9, My model load is really slow because it is using just the CPU. How can I get the model to run on my AMD GPU

Solution

Thank you to chrispresso

AMD ROCm seems to be the way to go, but it requires one to run under linux

Answered By - Dung Tran