Page 1 of 1

[Finished] Testing new CDN providers for Factorio

Posted: Thu Jan 20, 2022 5:04 pm
by vinzenz
Update
Thank you all for your results. The CDN provider testing has concluded.


Original:
Want to flex your internet connection?

I'm evaluating new CDN providers for our website assets, game and mod downloads. I'm interested in your download experience regarding these URLS: All links expire on 27. January. Please also tell me your general location so I can see geographic differences.

On Linux, Mac and even current Windows 10 releases you can get more detailed download stats on the command line with

Code: Select all

curl -O "https://...."
Ideally you download these URLs serially for 2-3 times, to ensure the file is actually cached by the CDN server.

Here's a small script that will download from all three CDNs individually. In total it will download 4.5 GB so please don't run it on a rated internet connection.

Code: Select all

echo "Wube CDN"; curl -O "https://dcdn.factorio.com/releases/FactorioDemo_x64_1.1.50.zip?key=0ZZB4yoVt_Frr0wSKyJ44A&expires=1643297090"
echo "CDN77"; curl -O "https://cdn1.factorio.com/FactorioDemo_x64_1.1.50.zip?secure=g7b-WjmyRUIY6IQU59DSIg,1643297071"
echo "BunnyNet"; curl -O "https://cdn2.factorio.com/FactorioDemo_x64_1.1.50.zip?token=ziTHfRcTXTk3T4hn8k6Kbs-ghgR0pPA5ePaUXVl6jjE&expires=1643297081"

Re: Testing new CDN providers for Factorio

Posted: Thu Jan 20, 2022 6:04 pm
by FuryoftheStars
May have been my fault, but leaving the error report here


Windows 10. ISP is xFinity, 200 Mbps down. I'm located in USA, New England region (if you need more specific than that, just let me know).

Output

For anyone interested in automating the whole thing...

Re: Testing new CDN providers for Factorio

Posted: Thu Jan 20, 2022 8:35 pm
by orzelek
My ISP is UPC in Poland - 1000/40 link.
I have results from 3 tries:
Results
And they seem to vary a bit and I think CDN77 and Wube are throttling sometimes since it ends quite round number.

Re: Testing new CDN providers for Factorio

Posted: Thu Jan 20, 2022 10:14 pm
by kirazy
Output for 3x trials in series
I note that I have historically had a lot of issues with the current CDN with very slow download/uploads (often maxing out at 300 KB/s).

I'm in Redmond, WA, USA just outside of Seattle, WA, USA with Ziply Fiber as my ISP, rated for 1 gbps up/down, on Windows 11. Looking at the results, only CDN77 performs as I would expect, the other two I wouldn't consider "working" at all.
Speedtest

Re: Testing new CDN providers for Factorio

Posted: Thu Jan 20, 2022 10:41 pm
by aka13
I'm in Berlin, Germany, propably the only good thing here is the internet.
I have a 1000/50 link.
Screenshot 2022-01-20 233253.png
Screenshot 2022-01-20 233253.png (16.64 KiB) Viewed 4766 times
WubeCDN x3

CDN77x3
BunnyNet

Re: Testing new CDN providers for Factorio

Posted: Thu Jan 20, 2022 10:50 pm
by Xorimuth
macOS 12.2 in SE England. CDN77 is much much better than the other 2.

Code: Select all

#1
Wube CDN
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1400M  100 1400M    0     0  12.2M      0  0:01:54  0:01:54 --:--:-- 12.8M
CDN77
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1400M  100 1400M    0     0  67.7M      0  0:00:20  0:00:20 --:--:-- 73.6M
BunnyNet
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1400M  100 1400M    0     0  9037k      0  0:02:38  0:02:38 --:--:-- 9484k

#2
Wube CDN
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1400M  100 1400M    0     0  9853k      0  0:02:25  0:02:25 --:--:-- 8020k
CDN77
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1400M  100 1400M    0     0  73.7M      0  0:00:18  0:00:18 --:--:-- 79.5M
BunnyNet
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1400M  100 1400M    0     0  7292k      0  0:03:16  0:03:16 --:--:-- 1558k
Screenshot 2022-01-20 at 22.49.39.png
Screenshot 2022-01-20 at 22.49.39.png (39.26 KiB) Viewed 4761 times

Re: Testing new CDN providers for Factorio

Posted: Thu Jan 20, 2022 10:51 pm
by Nexarius
1.png
1.png (69.4 KiB) Viewed 4761 times

Re: Testing new CDN providers for Factorio

Posted: Fri Jan 21, 2022 10:09 am
by maniak1349
Southwest of Russia. Connection supposed to be 100 Mbit, but it's not really there, so 11.1M is probably my actual top speed.
BunnyNet speed was going up to maximum during 2nd and 3d run, but at times it was dropping down significantly.
Results

Re: Testing new CDN providers for Factorio

Posted: Fri Jan 21, 2022 2:50 pm
by Tertius
Germany, 20 km from Frankfurt. 500 mbit/s cable internet.
results

Re: Testing new CDN providers for Factorio

Posted: Fri Jan 21, 2022 4:12 pm
by DerGraue
Germany, 1Gbit/s

Code: Select all

"Wube CDN"
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1400M  100 1400M    0     0  55.0M      0  0:00:25  0:00:25 --:--:-- 41.6M


"CDN77"
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1400M  100 1400M    0     0  34.2M      0  0:00:40  0:00:40 --:--:-- 35.5M


"BunnyNet"
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1400M  100 1400M    0     0  4340k      0  0:05:30  0:05:30 --:--:-- 4344k

Re: Testing new CDN providers for Factorio

Posted: Fri Jan 21, 2022 5:57 pm
by robot256
USA Mid-Atlantic, Verizon Fios Gigabit, i5-3570K w/ Samsung 840 Pro SSD, Win10.

Average speeds:
Wube CDN: 6.9MB/s, 5.3MB/s, 5.3MB/s (3:25 best)
CDN77: 96.8MB/s, 99.4MB/s, 96.0MB/s (0:14 best)
BunnyNet: 0.8MB/s, 4.8MB/s, 29.0MB/s, 14.4MB/s (0:48 best)

Re: Testing new CDN providers for Factorio

Posted: Fri Jan 21, 2022 8:11 pm
by quyxkh
Los Angeles, T-Mobile Home Internet, I got basically full available bandwidth, they guaranteed me 50Mbps and told me if I ever got less than that they'd fix it, what they were seeing was people in my area got about 150, sometimes 200Mbps, couldn't promise that but that's what they were seeing when I talked to them a year ago. I started out getting 150-200Mbps. But it's gotten better since, I generally get 300Mbps and up, late night it pushes gigabit and I think that's my ethernet saturating.

Wube CDN averaged ~40MB/s
CDN77 averaged ~48MB/s
Bunny would start out slow then get worse, clamping to 2MB/s or less

Forcing ipv6 (by deleting the ipv4 default route)

Wube CDN averaged 33MB/s
CDN77 averaged 31MB/s
Bunny is unreachable

On retrying the ipv6, data rates were 44.0,47.3,- , which is why I think wube and cdn77 can saturate the cell network capacity at the moment I'm testing, it'd take more tries to tell whether cdn77's apparent advantage is just luck. Bunny sucks regardless.

Re: Testing new CDN providers for Factorio

Posted: Sat Jan 22, 2022 1:41 am
by ptx0
my experience is weird. none of them perform as i'd expect, with speed oscillations.

however, my own server in Quebec, and others, allow full throughput with zero oscillation.

that said, CDN77 is the best of the three, it might actually finish the download someday.

But I'm at a loss as to explain why only Factorio's downloads go poorly for me, through browser or curl.
Screenshot_20220121_181907.png
Screenshot_20220121_181907.png (25.6 KiB) Viewed 4486 times
added a tcpdump output from the initial burst before it drops to 6kB/sec.

tcpdump.txt
(2.01 MiB) Downloaded 90 times

Re: Testing new CDN providers for Factorio

Posted: Sat Jan 22, 2022 2:21 am
by Silari
USA in northern New York here with Spectrum.

Code: Select all

"Wube CDN"
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1400M  100 1400M    0     0  10.4M      0  0:02:14  0:02:14 --:--:-- 10.8M
100 1400M  100 1400M    0     0  11.1M      0  0:02:06  0:02:06 --:--:-- 11.1M
100 1400M  100 1400M    0     0  10.8M      0  0:02:09  0:02:09 --:--:-- 10.4M

"CDN77"
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1400M  100 1400M    0     0  8691k      0  0:02:45  0:02:45 --:--:-- 9608k
100 1400M  100 1400M    0     0  8338k      0  0:02:52  0:02:52 --:--:-- 7470k
100 1400M  100 1400M    0     0  8798k      0  0:02:43  0:02:43 --:--:-- 8547k


"BunnyNet"
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1400M  100 1400M    0     0  7548k      0  0:03:10  0:03:10 --:--:--  9.8M
100 1400M  100 1400M    0     0  10.9M      0  0:02:08  0:02:08 --:--:-- 11.2M
100 1400M  100 1400M    0     0  1104k      0  0:21:38  0:21:38 --:--:--  621k
A fourth attempt on CDN77 failed after 1261M averaging 9295k/s
BunnyNet had a lot of up/down variance in speed, including drops down to 0kb/s. It never errored out though.

Re: Testing new CDN providers for Factorio

Posted: Sun Jan 23, 2022 8:39 pm
by ThaPear
Speedtest.png
Speedtest.png (16.19 KiB) Viewed 4393 times
The Netherlands, 200/200 internet, apparently faster upload than advertised. :D
BunnyNet is clearly the weakest here.

Code: Select all

"Wube CDN"
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1400M  100 1400M    0     0  24.1M      0  0:00:58  0:00:58 --:--:-- 24.0M
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1400M  100 1400M    0     0  24.1M      0  0:00:58  0:00:58 --:--:-- 23.9M
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1400M  100 1400M    0     0  24.1M      0  0:00:58  0:00:58 --:--:-- 23.9M
"CDN77"
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1400M  100 1400M    0     0  23.3M      0  0:01:00  0:01:00 --:--:-- 23.3M
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1400M  100 1400M    0     0  23.3M      0  0:01:00  0:01:00 --:--:-- 22.8M
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1400M  100 1400M    0     0  22.5M      0  0:01:02  0:01:02 --:--:-- 22.1M
"BunnyNet"
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1400M  100 1400M    0     0  6670k      0  0:03:35  0:03:35 --:--:-- 8343k
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1400M  100 1400M    0     0  17.2M      0  0:01:21  0:01:21 --:--:-- 22.8M
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100 1400M  100 1400M    0     0  19.4M      0  0:01:12  0:01:12 --:--:-- 23.4M