Quality and Experience Testing

[#1]

Hi all,
We're currently looking at the experience that our customers get across the whole end to end network from the Internet through to your home. We've got tests, reports and probes that look at different aspects of performance but they don't substitute for what you guys in the forum see and say.
We're expecting a busy night on Monday because of the Manchester derby. Last Tuesday we saw 12% of our network capacity being used by people watching/listening to Barcelona v Chelsea and 13% on Sunday lunchtime for Manchester Utd v Everton and the Bahrain Grand Prix. Monday could beat these.
Therefore we want to see how everything performs. There was a thread with some reports of performance issues on Tuesday which didn't correlate against any of the monitoring we have in place; we suspect the slow downs were localised rather than on the global network.
What we want to see then is for a group of users to run some tests and let us know what they see, particularly between about 7:30pm and 10pm on Monday.
Useful tests include but not limited to, the Thinkbroadband latency test: http://www.thinkbroadband.com/ping speedtests, or just the experience you see on loading pages, streaming, gaming etc.
If you can help us and provide the results it would be really appreciated, let us know if you've any questions.

[#2]

I am on a samknow monitor
recent results below, it does checks as per clip 2

[#3]

Aye, I could give that a go on Monday - i certainly shan't be watching any sport.
Results posted to this thread?

[#4]

"Useful tests include but not limited to, the Thinkbroadband latency test, or just the experience you see on loading pages, streaming, gaming etc."
Doesn't sound like much of a Quality test to me.  Can you not ask for something a little more specific?

[#5]

I'm sure that my son will give me some 'quality feedback' if his gaming starts to lag.

[#6]

Quote from: cobcottageonline

"Useful tests include but not limited to, the Thinkbroadband latency test, or just the experience you see on loading pages, streaming, gaming etc." Doesn't sound like much of a Quality test to me.  Can you not ask for something a little more specific?

I'm sorry, I don't agree with you. Users with technical ability will run various tests. Users who aren't technically able don't want to be confused or put off by a lot of technical requirements that they don't understand.
If a user reports "All my web pages took about twice as long to load" or "Browsing to .......... kept timing out every other time I tried" then that is still useful Experience testing.

[#7]

Well I'll be trying to use sky go to watch the match as I did on Tuesday when I had quite a lot of slow down.
Will see how it performs tonight. Hopefully better

[#8]

Thanks for offering to help all. There are a few specific tests we'd like you to try both during and either before/after the football.
We'd like to try and keep the results in a similar format to make things easier, so please see my example below for what we're after.

Time of test: XX.XXpm
Gateway:  http://users.plus.net/@gateway_custom?debug-ip=yes ; (only copy and paste the part under 'Array')
Link to TBB meter: http://www.thinkbroadband.com/ping/share/97513ce343193ba926e29e340d0388c8.html
Speedtest results: http://www.thinkbroadband.com/speedtest/broadband.html
iPlayer diagnostic results: http://www.bbc.co.uk/iplayer/diagnostics
Streaming (does it play smoothly or buffer?):
Also please feel free to give general feedback on your Internet experience this evening.

[#9]

OK, to kick this off, @1758
You are using a debugging mode - and checking  IP 87.113.236.xxx (if you need that I can PM it) 20CN Market 1.
Array
(
   [0] =>  1  vl7.sec.ptb-gw4.plus.net (212.159.3.25)  0.584 ms
   [1] =>  2  vl421.pih-gw3.plus.net (212.159.1.171)  0.573 ms
   [2] =>  3  gi1-1.ptn-gw01.plus.net (212.159.1.178)  11.468 ms
   [3] =>  4  ae3.ptw-cr01.plus.net (195.166.129.32)  11.341 ms
   [4] =>  5  ae1.pcl-cr01.plus.net (195.166.129.1)  11.717 ms
   [5] =>  6  po2.pcl-gw01.plus.net (195.166.129.41)  11.711 ms
   [6] =>  7  te2-1-230.pcl-gw02.plus.net (84.92.6.61)  11.740 ms
   [7] =>  8  gi13-1-2-232.pcl-ag02.plus.net (84.92.6.51)  21.568 ms
   [8] =>  9  *
)
You are currently connected to the gateway known as pcl-ag02.
This is located in City Lifeline House.
Can you tell me what the * at [8] => 9 means?

[#10]

At ~ 18:05
    [0] =>  1  vl7.sec.ptb-gw4.plus.net (212.159.3.25)  0.642 ms
    [1] =>  2  vl427.pih-gw3.plus.net (212.159.1.123)  0.558 ms
    [2] =>  3  gi1-1.ptn-gw01.plus.net (212.159.1.178)  11.330 ms
    [3] =>  4  po4.ptn-gw02.plus.net (212.159.1.139)  11.585 ms
    [4] =>  5  po6.ptw-gw01.plus.net (212.159.1.136)  11.837 ms
    [5] =>  6  gi13-0-1.121.ptw-ag01.plus.net (84.92.6.105)  15.687 ms
    [6] =>  7  *********.plus.com (212.159.***.***)  25.076 ms
TBB: http://www.thinkbroadband.com/ping/share-large/e1354dc06af7bda1c4cf47b923148568.png

[#11]

Time of test: 6.20pm
  [0] =>  1  vl7.sec.ptb-gw4.plus.net (212.159.3.25)  0.545 ms
    [1] =>  2  vl427.pih-gw3.plus.net (212.159.1.123)  0.569 ms
    [2] =>  3  gi1-1.ptn-gw01.plus.net (212.159.1.178)  18.826 ms
    [3] =>  4  gi11-0-0-321.ptn-ag03.plus.net (84.92.2.56)  12.465 ms
    [4] =>  5  XXXXX.plus.com (80.229.250.XXX)  31.699 ms
http://www.thinkbroadband.com/ping/share/97513ce343193ba926e29e340d0388c8.html

[#12]

Pre-match:
Array
(
   [0] =>  1  vl7.sec.ptb-gw4.plus.net (212.159.3.25)  0.661 ms
   [1] =>  2  vl421.pih-gw3.plus.net (212.159.1.171)  0.580 ms
   [2] =>  3  gi1-1.ptn-gw01.plus.net (212.159.1.178)  11.337 ms
   [3] =>  4  84.93.252.253.broadband.plus.dyn.plus.net (84.93.252.253)  11.470 ms
   [4] =>  5  gi15-0-0-342.ptn-ag03.plus.net (84.93.253.50)  17.080 ms
   [5] =>  6  My house  26.082 ms
)
You are currently connected to the gateway known as ptn-ag03.
my latency graph at tbb is borked as i had ping turned off


Streaming Sky sports 1 on sky go is fine, all done wirelessly.
Also note: all the same apps and other users running as last week, so valid like for like tests.

[#13]

Time of test:8.05pm
Same gateway and same TBB link

[#14]

after 10 minutes, looking much better than last Tuesday - sky go is working for a start!
gateway as before

[#15]

During match.
Array
(
   [0] =>  1  vl7.sec.ptb-gw4.plus.net (212.159.3.25)  0.567 ms
   [1] =>  2  vl421.pih-gw3.plus.net (212.159.1.171)  0.568 ms
   [2] =>  3  gi1-1.ptn-gw01.plus.net (212.159.1.178)  67.059 ms
   [3] =>  4  ae3.ptw-cr01.plus.net (195.166.129.32)  16.952 ms
   [4] =>  5  ae2.ptw-cr02.plus.net (195.166.129.5)  11.466 ms
   [5] =>  6  ae1.pcl-cr02.plus.net (195.166.129.3)  17.717 ms
   [6] =>  7  po2.pcl-gw02.plus.net (195.166.129.43)  17.590 ms
   [7] =>  8  gi15-1-1-452.pcl-ag04.plus.net (84.93.255.146)  14.218 ms
   [8] =>  9  end point 21.329 ms
)
You are currently connected to the gateway known as pcl-ag04.
http://www.thinkbroadband.com/ping/share-large/c144c7c792d48dfdc1d2ac332cdc8a68.png
(Ping is usually ~15 ms and speed ~75Mbps)

Streaming is poor quality with a fair bit of buffering.
adie:green removed ip address of user