Reader

Download File only when Changed using wget/curl

| 涛叔 | Default
I am working on one ChatGPT based Product, and it need to download the cl100k_base.tiktoken file via HTTP protocol to count the token consumed in the streaming API. Although the tiktoken file is not very big (1.7M), its content rarely changes. So there is no need to wate net traffic to download the entire every time. In this article, I am going to share how to download file only if its content changed by wget or curl.