Add gpufaq

FAQ.md

@@ -100,3 +100,8 @@ Make sure to run the command as follows
 A:
 The issue occurs because of not copying the URL correctly. If you right click on the link and copy the link, the link may be copied with url defence wrapper.
 To avoid this problem, please select the url manually and copy it
+
+
+**Q: What GPU can I use to run the code in this repository?**
+
+A: The code in this repository only supports NVIDIA GPUs. While hardware requirements vary based on latency, throughput and cost constraints, good performance was observed when the models were split across multiple GPUs with tensor parallelism in a machine with NVIDIA A100s or H100s. But other types of GPUs like A10G, T4, L4, or even commodity hardware can also be used to deploy these models (e.g. https://github.com/ggerganov/llama.cpp).

README.md

@@ -57,6 +57,7 @@ torchrun --nproc_per_node 1 example_chat_completion.py \
 - The `–nproc_per_node` should be set to the [MP](#inference) value for the model you are using.
 - Adjust the `max_seq_len` and `max_batch_size` parameters as needed.
 - This example runs the [example_chat_completion.py](example_chat_completion.py) found in this repository but you can change that to a different .py file.
+- At this time the code in this repository only supports a **Linux Operating System with a NVIDIA GPU**.
 
 ## Inference