RE: [squid-users] StoreID - Need help with Yandex videos

From: Vdoctor <vdoctor_at_neuf.fr>
Date: Tue, 29 Apr 2014 16:52:41 +0200

Eliezer,

Thanks for the tips. ;o)
We are doing tests with the StoreID, do you know why many requests are as TCP_MISS ?
(we use your original ruby file and settings as indicated from the Squid website)

Bye Fred

-----Message d'origine-----
De : eliezer_at_ngtech.co.il [mailto:eliezer_at_ngtech.co.il]
Envoyé : mardi 29 avril 2014 16:33
À : Vdoctor
Objet : RE: [squid-users] StoreID - Need help with Yandex videos

These are the patterns which needs another part which you can read about
here:
http://wiki.squid-cache.org/Features/StoreID/DB

^http\:\/\/ncache\-ams([\d]+)\.video\.yandex\.net\/([\w\-\/\.]+(\.mp4|\.webm|\.flv))\?[\w\-\/\.\=\&]+(range\=[\d]+\-[\d]+)
^http\:\/\/ncache\-ams([\d]+)\.video\.yandex\.net\/([\w\-\/\.]+(\.mp4|\.webm|\.flv))\?[\w\-\/\.\=\&]+

The above are two patterns which should help you out.

Please forward it to the squid mailing list.

Eliezer

> Hello Eliezer,
>
>
>
> Here is an original link we catched from Squid log:
>
> http://video.yandex.ru/users/marinadoneck/view/304/
>
>
>
> We can see that as part of the video:
>
> 1398780658.429 1931 192.168.1.233 50:46:5d:a0:3e:5a TCP_MISS/200 1878642
> GET
> http://ncache-ams04.video.yandex.net/get-film/6d693cce03cfd40728ef0630
> 8db0f8
> 5e/marinadoneck/714lsmgfod.2603/public/sq.mp4?ref=video.yandex.ru&mp=0
> 3&toke
> n=ucse90gfjw7o6s9lc2wng.30iuwxq6db6ojtguhqxe2ule4.1398780655.91267701&
> src=cl
> ip26f.video.yandex.net&range=121764-1999999 -
> HIER_DIRECT/178.154.255.9
> video/mp4
>
>
>
> 1398780660.762 2294 192.168.1.233 50:46:5d:a0:3e:5a TCP_MISS/200 2000499
> GET
> http://ncache-ams04.video.yandex.net/get-film/6d693cce03cfd40728ef0630
> 8db0f8
> 5e/marinadoneck/714lsmgfod.2603/public/sq.mp4?ref=video.yandex.ru&mp=0
> 3&toke
> n=ucse90gfjw7o6s9lc2wng.30iuwxq6db6ojtguhqxe2ule4.1398780655.91267701&
> src=cl
> ip26f.video.yandex.net&range=1999907-3999999 -
> HIER_DIRECT/178.154.255.9
> video/mp4
>
>
>
> 1398780686.413 2057 192.168.1.233 50:46:5d:a0:3e:5a TCP_MISS/200 2002083
> GET
> http://ncache-ams04.video.yandex.net/get-film/6d693cce03cfd40728ef0630
> 8db0f8
> 5e/marinadoneck/714lsmgfod.2603/public/sq.mp4?ref=video.yandex.ru&mp=0
> 3&toke
> n=ucse90gfjw7o6s9lc2wng.30iuwxq6db6ojtguhqxe2ule4.1398780655.91267701&
> src=cl
> ip26f.video.yandex.net&range=3998323-5999999 -
> HIER_DIRECT/178.154.255.9
> video/mp4
>
>
>
> 1398780711.684 2829 192.168.1.233 50:46:5d:a0:3e:5a TCP_MISS/200 2003373
> GET
> http://ncache-ams04.video.yandex.net/get-film/6d693cce03cfd40728ef0630
> 8db0f8
> 5e/marinadoneck/714lsmgfod.2603/public/sq.mp4?ref=video.yandex.ru&mp=0
> 3&toke
> n=ucse90gfjw7o6s9lc2wng.30iuwxq6db6ojtguhqxe2ule4.1398780655.91267701&
> src=cl
> ip26f.video.yandex.net&range=5997033-7999999 -
> HIER_DIRECT/178.154.255.9
> video/mp4
>
>
>
> 1398780733.431 2122 192.168.1.233 50:46:5d:a0:3e:5a TCP_MISS/200 2020535
> GET
> http://ncache-ams04.video.yandex.net/get-film/6d693cce03cfd40728ef0630
> 8db0f8
> 5e/marinadoneck/714lsmgfod.2603/public/sq.mp4?ref=video.yandex.ru&mp=0
> 3&toke
> n=ucse90gfjw7o6s9lc2wng.30iuwxq6db6ojtguhqxe2ule4.1398780655.91267701&
> src=cl
> ip26f.video.yandex.net&range=7979871-9999999 -
> HIER_DIRECT/178.154.255.9
> video/mp4
>
>
>
> 1398780759.940 2080 192.168.1.233 50:46:5d:a0:3e:5a TCP_MISS/200 2000630
> GET
> http://ncache-ams04.video.yandex.net/get-film/6d693cce03cfd40728ef0630
> 8db0f8
> 5e/marinadoneck/714lsmgfod.2603/public/sq.mp4?ref=video.yandex.ru&mp=0
> 3&toke
> n=ucse90gfjw7o6s9lc2wng.30iuwxq6db6ojtguhqxe2ule4.1398780655.91267701&
> src=cl
> ip26f.video.yandex.net&range=9999776-11999999 -
> HIER_DIRECT/178.154.255.9
> video/mp4
>
>
>
> Marinadoneck is the name of the uploader
>
> token=ucse90gfjw7o6s9lc2wng.30iuwxq6db6ojtguhqxe2ule4.1398780655.91267
> 701 never changes, seems the last 2 parts (1398780655.91267701) are
> the date of start and the max duration, but we are not sure at 100%.
>
>
>
> Bye Fred
>
>
>
> -----Message d'origine-----
> De : Eliezer Croitoru [mailto:eliezer_at_ngtech.co.il] Envoyé : mardi 29
> avril 2014 15:44 À : squid-users_at_squid-cache.org Objet : Re:
> [squid-users] StoreID - Need help with Yandex videos
>
>
>
> Can you refer me to the example you do have in hands?
>
>
>
> One url wont be good enough.
>
> I need multiple urls of the same film.
>
> Basically it's the file name part from the path and the range query part.
>
>
>
> The token is a token so it changes every time to ensure couple things.
>
>
>
> This still dosn't garentee it will be cachabel.
>
>
>
> Eliezer
>
>
>
> On 04/29/2014 09:15 AM, Stakres wrote:
>
>> Hi All,
>
>>
>
>> I need your help with StoreID and Yandex videos.
>
>> Is someone able to spend 5 minutes to improve the ruby helper from
>
>> Eliezer with that sample of URL:
>
>>
>> <http://ncache-ams01.video.yandex.net/get-film/0466c0cc0b9b4796f3040b
>> 10>
> http://ncache-ams01.video.yandex.net/get-film/0466c0cc0b9b4796f3040b10
>
>> 0fad1c64/alesnikolaj/3sx3ftb08a.4312/public/medium.flv?ref=video.yand
>> e
>
>> x.ru&mp=12&token=fviattoh92hajai4ik67iz.fs2gbk5huc6e7ddo7kprj3o5yr.13
>> 9
>
>> 8751589.05365114&src=clip43e.video.yandex.net&range=14000000-15999999
>
>>
>
>> Your help will be highly appreciated
>
>>
>
>> Bye Fred
>
>>
>
>>
>
>>
>
>> --
>
>> View this message in context:
>
>>
>> <http://squid-web-proxy-cache.1019090.n4.nabble.com/StoreID-Need-help
>> -w>
> http://squid-web-proxy-cache.1019090.n4.nabble.com/StoreID-Need-help-w
>
>> ith-Yandex-videos-tp4665739.html Sent from the Squid - Users mailing
>
>> list archive at Nabble.com.
>
>>
>
>
Received on Tue Apr 29 2014 - 14:52:59 MDT

This archive was generated by hypermail 2.2.0 : Tue Apr 29 2014 - 12:00:07 MDT