Update README.md
Browse files
README.md
CHANGED
@@ -51,7 +51,7 @@ Here's what the train/eval loss looked like:
|
|
51 |
|
52 |
<img src="https://cdn-uploads.huggingface.co/production/uploads/662c17b252e194d5d436c708/hUKuy7ht_qObuFNDTVEe9.png" width="800"/>
|
53 |
|
54 |
-
I still don't know what makes training loss drop at the end of epoch 1, or why eval loss doesn't drop down to match (it continues to decrease, but slowly). I did say this was experimental, right?
|
55 |
|
56 |
It was trained with the following settings:
|
57 |
|
|
|
51 |
|
52 |
<img src="https://cdn-uploads.huggingface.co/production/uploads/662c17b252e194d5d436c708/hUKuy7ht_qObuFNDTVEe9.png" width="800"/>
|
53 |
|
54 |
+
I still don't know what makes training loss drop at the end of epoch 1, or why eval loss doesn't drop down to match (it continues to decrease, but slowly). I did say this was experimental, right? If I want to throw more money at this I might try a 3 epoch run just to see what happens.
|
55 |
|
56 |
It was trained with the following settings:
|
57 |
|