De elopmen o a Video
T ansmission Concep in he
Field o Teleope a ed D i -
ing
Repo N . 1322/18
Edi o : Roge Cla e ol | 2576914
Ad iso : Pa ick Pin sche M. Sc., Timm Ruppe M. Sc.
Roge Cla e ol
ma icula ion numbe : 2576914
cou se: Elec ical Enginee ing and In o ma ion Technology
Thesis N . 1322/18
opic: De elopmen o a Video T ansmission Concep in he Field o Teleope a ed D i ing
submi ed: 31s Augus 2018
Technische Uni e si ä Da ms ad
Fachgebie Fah zeug echnik
P o . D . e . na . He mann Winne
O o-Be nd -S aße 2
64287 Da ms ad
Summa y I
Summa y
This p ojec ini ially consis on he s udy and he pe o mance o he ideo ansmission pa o a
p ojec o eleope a ed d i ing o a am in he ci y o Da ms ad . The am whe e will be implemen ed
is in a pa o Da ms ad ha will ha e a 5G in as uc u es. The p ojec includes a s udy o 5G, also
4G and Wi-Fi ansmission, including da a a es and la ency, o ansmi in eal ime ideo om he
am o a cen al s a ion.
Ini ially he idea is o make a es - ig ha would be as simila as he p o o ype ha could be imple-
men ed in he am. The p o o ype would be some came as in on o he am connec ed wi h cables
o a compu e om whe e he da a will be p ocessed and send i h ough 4G/Wi-Fi in as uc u es o
a s a ic s a ion. The compu e will comp ess he da a, applying some codecs, o use less da a size o
he ansmission
The ini ial si ua ion o he es - ig is o connec a came a o a compu e , p ocess he da a ha ecei es
and send i o ano he compu e using E he ne cable. The p oblem is ha he E he ne cable mus be
ull duplex and he compu e s mus ha e a speci ic con igu a ion ha om he p o o ype would no
be help ul. In addi ion, he compu e i is used o make he es s is no compa ible wi h he compu e .
Finally he solu ion o hose p oblems a e sol ed ansmi ing wi h Wi-Fi, ins ead o he cable, and
o he ansmi ing ideo is used he web cam o he compu e / and a ideo downloaded om in e ne .
Fo he comp ession pa he e is a s udy o di e en codecs, and he p og amming o a code o apply
his codecs.
Table o con en II
Table o con en
Summa y ............................................................................................................................................... I
Table o con en .................................................................................................................................. II
Symbol and index di ec o y ............................................................................................................... III
Lis o abb e ia ion ............................................................................................................................ IV
Lis o igu es ...................................................................................................................................... V
Lis o ables ....................................................................................................................................... VI
1 In oduc ion .................................................................................................................................. 1
1.1 Mo i a ion ............................................................................................................................. 1
1.2 Conc e iza ion o he asks .................................................................................................... 1
1.3 Me hodology ......................................................................................................................... 2
2 S a e o he a .............................................................................................................................. 3
2.1 Concep o Teleope a ed d i ing........................................................................................... 3
2.2 O he exis ing p ojec s .......................................................................................................... 3
3 Requi emen s ............................................................................................................................... 4
4 Codecs .......................................................................................................................................... 5
4.1 MPEG4.................................................................................................................................. 5
4.2 H264/AVC ............................................................................................................................ 5
4.3 HEVC/H265 .......................................................................................................................... 6
4.4 Compa ison o he codecs ..................................................................................................... 7
5 T ansmission ................................................................................................................................ 8
5.1 4G .......................................................................................................................................... 8
5.2 5G .......................................................................................................................................... 8
5.3 Wi-Fi ..................................................................................................................................... 9
5.4 Compa ison o he T ansmission s anda ds .......................................................................... 9
6 Tes - Rig .................................................................................................................................... 10
6.1 Se up.................................................................................................................................... 10
6.1.1 Me hodology .................................................................................................................. 10
6.2 E alua ion o la ency .......................................................................................................... 11
6.3 E alua ion o da a a e ........................................................................................................ 16
7 Conclusion and ou look ............................................................................................................. 17
Annex ................................................................................................................................................. 18
Bibliog aphy.......................................................................................................................................23

Symbol and index di ec o y III
Symbol and index di ec o y
La in le e s:
symbol
uni
desc ip ion
None
G eek le e s:
symbol
uni
desc ip ion




Indexes:
symbol
desc ip ion
None
Lis o abb e ia ion IV
Lis o abb e ia ion
FZD Fachgebie Fah zeug echnik
MAAS Machba kei ss udie zu Au oma isiening und Assis enzsys emen de S aβenbahn
5G 5 h Gene a ion
4G 4 h Gene a ion
LTE Long Te m E olu ion
Wi-Fi Wi eless Fideli y
MPEG Mo ing Pic u e Expe s G oup
AVC Ad anced Video Coding
HEVC High E iciency Video Coding
TU Technische Uni e si ä
Mbi /s Megabi pe second
ps ames pe second
px pixels
Tx T ansmi e
Rx Recei e
RAM Random Acces Memo y
Lis o igu es V
Lis o igu es
Figu e 4.1 H264 blocks ........................................................................................................................ 6
Figu e 4.2 Mac oblocks in H.264 and H.265 ....................................................................................... 7
Figu e 6.1 Tes - ig.............................................................................................................................. 11
Figu e 6.2 lbx264 wi h 3 ames each packe .................................................................................... 12
Figu e 6.3 lbx264 wi h 5 ames each packe .................................................................................... 12
Figu e 6.4 VP8 wi h 5 ames each packe ........................................................................................ 13
Figu e 6.5 VP8 wi h 3 ames each packe ........................................................................................ 13
Figu e 6.6 VP9 wi h 5 ames each packe ........................................................................................ 14
Figu e 6.7 VP9 wi h 3 ames each packe ........................................................................................ 14
Figu e 6.8 La ency in T ansmission ................................................................................................... 15
Figu e 6.9 Da a a e in ansmission .................................................................................................. 16
Lis o ables VI
Lis o ables
Table 4.1 Ad an ages and disad an eges H264 ................................................................................... 6
Table 4.2 H264 s H265 ...................................................................................................................... 7
Table 6.1 In o ma ion o compu e s o es - ig ................................................................................ 10
4. Codecs 7
4.4 Compa ison o he codecs
MPEG-4 pa 2 s MPEG-4 pa 10
Pa 10 is mo e e icien o encode and a be e quali y, bu o be mo e e icien o encode i leads o
a highe powe consump ion. Fo his las p oblem o consuming mo e CPU, nowadays he e a e good
compu e s ha can educe his p oblem.
Table 4.2 H264 s H2657
H.264
H.265
Mac oblocks
Fixed mac oblocks o 16x16
Can use di e en mac oblocks om
8x8 o 64x64
Bi - a e
Less bi - a e
Resolu ion
Limi ed o 4k
Un il 8k
F ames pe
second
Limi ed o 60 ps
Un il 300 ps
Da a size
50% less han MPEG-2
50% less han h264
O he s
Mo e complex codec and CPU con-
sume
When he codec ge each ame, di ided he image in mac oblocks, in he case o H264 he mac-
oblocks a e o 16x16 pixels as is shown in he le side o Figu e 4.28. Howe e , as is shown on he
igh side o Figu e 4.2 in he case o H265 ge di e en sizes o mac oblocks because i compa es
he pixels and he pixels a ound, and i he e is a g ea amoun o simila , o example he same colo ,
hen he codec can ge a highe mac oblock un il 64x64. Mo eo e , on he o he case when he e a e
many di e en pixels hen he codec ge a small mac oblocks as 8x8 pixels o his pa o he image.
7 H.264 & H.265/HEVC COMPARISON.
8 HEVC. Wha 's nex in ideo comp ession.
Figu e 4.2 Mac oblocks in H.264 and H.265

5. T ansmission 8
5 T ansmission
When we alk abou ansmission and wi eless communica ion, we alk abou ansmission o elec i-
cal signals ha a el h ough he ai as adio wa es. This is a opic connec ed o he mobile commu-
nica ion since he inals o he 70’s wi h he appea ance o he i s gene a ion o mobile communi-
ca ion. Since hen un il now he ollowing gene a ions ha e su passed and by a he p e ious ones.
The i s change was wi h he second gene a ion ha changed o a ansmission o digi al oice, he
possibili y o sending SMS and he oaming ha le an owne o a mobile phone o mo e a ound he
wo ld. The second change came wi h he hi d gene a ion. I appea ed he possibili y o connec o
in e ne , a g ea no el y o he mobile communica ion sec o . A e he hi d gene a ion appea ed he
ac ual one 4G, and nowadays is in p ocess 5G. Those las wo gene a ions a e he impo an o his
p ojec .9
The ansmission is he mos impo an pa on his p ojec s because, i a ec s on he da a a e and
he la ency. Is he pa whe e i could no ha e p oblem because low da a a e means ha he ideo
has a b eak, no s eaming and no hing o show in he s a ic s a ion. Fo he ansmission pa he e a e
some wi eless ne wo ks ha could be he mos app op ia e. Fo his case he e is WLAN ha has a
ange om 10 me e s o some hund eds o me e s as Wi-Fi, o WWAN ha use mobile communica-
ion and wi h he help o some epea e s is he bes op ion o ansmi da a nowadays.10 Nowadays
om he mobile communica ion he one ha is being used he mos is 4G, and also a new gene a ion
ha exis s o a ew yea s ago is 5G bu i is s ill in p ocess o implemen ing.
5.1 4G
Fou h gene a ion is he ac ual mobile gene a ion s anda d. I is o ally based in IP, which means ha
use all he p o ocols o send and ecei e da a in packe s11. Can o e highe download speed han his
p edecesso , 3G, I can o e a download speed o 1 Gbps in an s a ic posi ion and a maximum 100
Mbps in mo emen . The no el y espec he p e ious gene a ion is ha he possibili y o he s eam-
ing ideos. This echnology has a bandwid h be ween 3 kHz and 6 GHz and depends on he con inen
o he wo ld in ope a es in di e en equency bands.12
5.2 5G
The new gene a ion ha will o e be e condi ions han his p edecesso 4G. This gene a ion has wo
laye s; a mac olaye ha wo ks in he mic owa e band and p o ides use plan a ic, and a mic o
laye ha wo ks in he mm-wa e band and ca ies use plan a ic. This wo laye s a e e lec ed in
9 E olu ion o mobile communica ion (2018).
10 Wi eless Ne wo ks.
11 NATHAN CHANDLER: How 4G Wo ks.
12 Tabla de ecuencias 4G.
5. T ansmission 9
he bandwid h ha has inc ease espec o he p e ious gene a ion, 4G, o a ange be ween 3 kHz and
300 GHz.
The mic owa es has a p oblem ha hey couldn´ pass h ough he walls, and he ees and he clouds
abso b hem. The solu ion ha is ound is he implemen a ion o mic ocell ha hey can epea ed he
signal. This solu ion en ails he cons uc ion o new in as uc u es ha could make a new gene a ion
ha will a i e e e ywhe e.13
Fo he e m on he bi a e and he la ency, i is said ha he bi a e is going o inc ease o 1Gbps and
could go as e un il 10 Gbps.14 This inc ease on he bi a e will a ec posi i ely on he la ency
because he ile will be ansmi ed as e and he la ency will be lowe . A e y impo an aspec o
he li e ideos.
5.3 Wi-Fi
Is a echnology ha allows he connec ion be ween elec onic de ices no mally in places wi h an
access poin ha all he de ices can be connec ed. I is used o Local a ea ne wo ks as companies o
pa icula houses. I use o ope a es in he equency band o 2,4 GHz15 o e ing a download da a a a
un il 300 Mbps.
5.4 Compa ison o he T ansmission s anda ds
The mos signi ican di e ence be ween he ansmission s anda ds is ha o he new mobile gene -
a ion i is an ex ension o he bandwid h, because i is p edic ed ha in a u u e he e will be mo e and
mo e appliance connec ed o in e ne and he ou h gene a ion will be sho o o e se ice o all.
This will lead o de massaging o connec ed objec s.
Also a e y signi ican di e ence is ha he da a a es o downloading o 5G will be 100 imes highe
han 4G, and his implies he la ency will be e y low.16
13 Wha Is 5G and How Will I Make My Li e Be e ?
14 Gemal o: In oducing 5G ne wo ks.
15 WLAN F equency Bands & Channels.
16 4G s 5G (2017).
6. Tes - Rig 10
6 Tes - Rig
A e all he s udy o he equi emen s hen i mus pu in p ac ice all he collec ed in o ma ion and
as he e is no he inal p o o ype ha will go in he am, i is needed a p e ious es - ig o see he
possible p oblems ha could be in a gene al si ua ion, and sol e hem be o e he p o o ype in he am
6.1 Se up
Fo he se up, i is necessa y wo compu e s, one o ansmi he ideo and he o he one o ecei e
and plays he ideo. In he Table 6.1, he e a e he cha ac e is ics o he compu e s used. Bo h com-
pu e a e simila bu he RAM is be e in he ecei e , ha could a ec on he la ency o he com-
p ession o he da a.
Table 6.1 In o ma ion o compu e s o es - ig
Compu e 1 (Tx)
Compu e 2 (Rx)
- Windows 10 Educa ion
- In el® Co e™ i5-2450M CPU @ 2.50 GHz
2.50 GHz
- RAM 4,00 GB
- Windows 7 p o essional
- In el® Co e™ i5-2450M CPU @ 2.50 GHz
2.50 GHz
- RAM 8,00 GB
I is also necessa y a came a. The i s op ion was o connec a came a ha has he same esolu ion
and he same numbe o ps as he possible came as ha will be ins alled in he am. Howe e , o
p oblems o compa ibili y wi h compu e 1 and he came a inally i is decided o use a ideo down-
loaded on in e ne o he web cam o he compu e 1.
Once he es - ig is wi h all he complemen s, in his case jus bo h compu e s, hen i is in es iga e
abou how o make all he p ocess cap u ing he image, comp essing, ansmi ing and ecei ing and
hen ep oduce he ideo. Fo he p ocess, using bo h compu e s i has been used a PyCha m p og am
ha is used o modi y and un py hon sc ip s and i has been also used a p og am named F mpeg ha
is used o applying he codecs.
6.1.1 Me hodology
The all p ocess is di ided in he wo compu e s and ollow he nex p ocesses. The compu e ha i
is ansmi ing has ou p ocesses o pe o m: Cap u e he ideo, comp ess, ansmi and inally a e
he ansmission, dele e he ile om he compu e . This las p ocess is impo an because in he inal
p o o ype, i he iles a e no e ased, he compu e will needed a huge capaci y and consequen ly a
bigge compu e o s o e all he da a. The compu e ha is ecei ing has h ee p ocesses o pe o m:
6. Tes - Rig 11
Recei e da a, decomp ess, plays he ideo and dele e he ile, e y impo an p ocess as in he
T ansmi e compu e .
On he Compu e 1 he cap ion o he ideo is ame by ame, and hen a ideo ile is c ea ed a aching
some ames. A e he c ea ion o he ile, i is comp essed applying some codecs, send i o he
compu e 2, dele e i and hen ano he ime epea ing he p ocess. On he compu e 2 is he same all
he p ocess a e pe o med one a e he o he and a e de dele ing p ocess again o he ecei ing
p ocess, ha ha e o wai un il he compu e 2 ecei es da a (Figu e 2).
The me hodology was co ec , bu he p oblem was ha he ep oduc ion o he ideo was so slow
and he la ency was high. The solu ion o his p oblem was add socke s ha makes ha he p ocesses
wo k simul aneously. On he compu e 1 he cap u e o he ideo c ea es iles wi h he numbe o
ames i is desi ed. When he e is an exis ing ile c ea ed, hen he p ocess o comp essing begins a
comp ess his ile is c ea ed. This p ocess only can p oceed i he e is any exis ing ile c ea ed ha is
no al eady comp ess i . Then he p ocess o T ansmi ha depends on he las p ocess. Only when a
comp essed ile exis s and is no al eady send i hen can send i . Finally he p ocess o dele e ha
depends on he las p ocess oo. All he ou p ocesses wo ks a he same ime bu he signi ican
di e ence wi h he i s me hod is ha he cap ion o ideo do no wai un il he dele e is done.
On he compu e 2, as in he compu e 1, he ou blocks wo ks simul aneously and he ecei e p ocess
do no ha e o wai un il he dele e p ocess is done. The ecei e p ocess is keeping all he da a e-
cei ed, be o e being used o he o he p ocesses.
6.2 E alua ion o la ency
In he e alua ion o he la ency, i s i is decided i i is be e o use he web cam o he compu e 1
o a downloaded ideo in aw ideo. I was decided ha was going o be he web cam because, in he
p ocess o cap u ing he ideo, he la ency is lowe han using he downloaded ideo and i is close
o he inal p o o ype.
CAPTURE VIDEO
COMPRESS
DELETE
TRANSMIT
Compu e 1
RECEIVE
DECOMPRESS
DELETE
PLAY VIDEO
Compu e 2
Figu e 6.1 Tes - ig
6. Tes - Rig 12
One p oblem on he e alua ion is ha bo h compu e s a e connec ed o in e ne o he same webpage,
bu each one has a di e en p ocesso and hen hey had di e en ime. The wo clocks di e om a
ew seconds, hen o s udy exac ly he how is he la ency, i is needed i s o synch onize bo h com-
pu e s. The solu ion was o make a TCP connec ion, ha when a packe is send he e is an answe
o m he o he compu e and on his case, he answe is o send he same packe back. In his p ocess,
i is ob ained he ic ional ime ha would be in he compu e 2 when he packe is ecei ed. Wi h his
ime and he eal ime o he compu e 2 cap u e i a he ecei ed ime, i can be de e mined an o se .
Du ing he whole p ocess, he e a e di e en p ocesses ha can a ec conside ably in he la ency
ime:
- The comp ession
This p ocess is he one ha depending on he compu e -p ocessing uni will do i as e o slowe .
The nex igu es a e applying di e en codecs
Bo h igu es Figu e 6.3 and Figu e 6.2 a e pe o med using lbx264 ha is he lib a y o he h264
codec, i can be obse ed han wi h mo e ames he codec wo ks be e .
0
50
100
150
200
250
300
350
400
919 29 39 49 59 69 79 89
La ency [ms]
Numbe package
Figu e 6.3 lbx264 wi h 5 ames each packe
0
50
100
150
200
250
300
350
919 29 39 49 59 69 79 89
La ency [ms]
Numbe package
Figu e 6.2 lbx264 wi h 3 ames each packe

6. Tes - Rig 13
Al hough he p ocesso o he compu e always a ec in his p ocess, i can be obse ed han in Figu e
6.5 and Figu e 6.4 i wo ks be e wi h mo e ames pe packe in he codec o VP8. This codec is a
ee e sion o he codec h264.
Fo he nex wo igu e, Figu e 6.6 and Figu e 6.7, i is applied he VP9 codec ha is he sucesso o
he VP8, and he same case as VP8, is he ee e sion o he codec h265. Compa ing bo h pic u es i
0
100
200
300
400
500
600
700
800
900
919 29 39 49 59 69 79 89
La ency [ms]
Numbe package
Figu e 6.5 VP8 wi h 3 ames each packe
0
50
100
150
200
250
300
350
400
919 29 39 49 59 69 79 89
La ency [ms]
Numbe package
Figu e 6.4 VP8 wi h 5 ames each packe
6. Tes - Rig 14
an be obse ed han he la ency o p ocessing wi h less ames pe packe is always nea o he a e -
age, wi hou la ency peaks.
0
100
200
300
400
500
600
700
919 29 39 49 59 69 79 89
La ency [ms]
Numbe package
Figu e 6.6 VP9 wi h 5 ames each packe
0
50
100
150
200
250
300
350
400
450
500
919 29 39 49 59 69 79 89
La ency [ms]
Numbe package
Figu e 6.7 VP9 wi h 3 ames each packe
6. Tes - Rig 15
- The ansmission
In his p ocess, i is used a simple packe o 8 by es o ansmi om one compu e o he o he one
and he esul is shown on Figu e 6.8.
As i is shown he e is an a e age o he la ency ansmission be ween 51 and 52 miliseconds. The e
a e some peeks ha each up o 63 miliseconds ha could be o he small size o he ansmission
package
Figu e 6.8 La ency in T ansmission
La ency (s)
Packe numbe sen
6. Tes - Rig 16
6.3 E alua ion o da a a e
In he e alua ion on he da a, is mo e o less he same han he e alua ion o he la ency because he
da a a e will be ge i om he la ency and he size o he sen packe . In he shown Figu e 6.9 he
axis in e ical is he da a a e in By es/ second, and o ge he da a a e in bps, i is only needed o
mul iply he ob ained a e by 8. The ho izon al axis is he numbe o he package sen .
The e a maximum o da a a e o 500 By es pe second, equally o 4kbps, ha is no e high, and an
a e age o da a a e o 410 By es pe second, equally o 3,28 kbps, also no e y high. This low da a
a e does no show he maximum da a a e ha could each he connec ion, p obably o he small
size o he da a sen .
Figu e 6.9 Da a a e in ansmission
Da a a e (B/s)
Packe numbe sen
Annex 23
Bibliog aphy
4G s 5G (2017) 4G s 5G; h ps://www.econec ia.com/blog/4g- s-5g-di e encias, 2017, Access
22/08/2018
A No el S udy on Da a Ra e by he Video T ansmission o Teleope a ed Road Vehicles
(2013) A No el S udy on Da a Ra e by he Video T ansmission o Teleope a ed Road Vehicles;
h ps://media um.ub. um.de/doc/1188692/1188692.pd , 2013, Access 27/08/2018
An O e iew o H.264 Ad anced Video Coding An O e iew o H.264 Ad anced Video Coding;
h ps://www. codex.com/an-o e iew-o -h264-ad anced- ideo-coding/, Access 22/08/2018
Di e ence be ween lossy and lossless Di e ence be ween lossy and lossless; h p://askdi e -
ence.blogspo .com/2016/09/di e ence-be ween-lossy-and-lossless30.h ml
E icsson ini ia es 5G mo o way p ojec wi h c oss-indus y conso ium in Ge many (2016)
E icsson ini ia es 5G mo o way p ojec wi h c oss-indus y conso ium in Ge many;
h ps://www.e icsson.com/en/news/2016/11/e icsson-ini ia es-5g-mo o way-p ojec -wi h-c oss-in-
dus y-conso ium-in-ge many, 2016
E olu ion o mobile communica ion (2018) E olu ion o mobile communica ion;
h ps://www.uni e sidad iu.com/e olucion-la- ed-comunicacion-mo il-del-1g-al-5g/, 2018, Access
29/08/2018
Gemal o: In oducing 5G ne wo ks
Gemal o: In oducing 5G ne wo ks; h ps://www.gemal o.com/b ochu es-si e/download-si e/Docu-
men s/ el-5G-ne wo ks-QandA.pd
H.264 & H.265/HEVC COMPARISON H.264 & H.265/HEVC COMPARISON;
h ps://www.pamdis .com/pages/ aq-wha -is- he-di e ence-in-h-264-h-265-he c
HEVC. Wha 's nex in ideo comp ession HEVC. Wha 's nex in ideo comp ession;
h p://z3 echnology.com/News/HEVC-Wha -is-nex -in- ideo-comp ession/26.h ml, Access
30/08/2018
NATHAN CHANDLER: How 4G Wo ks
NATHAN CHANDLER: How 4G Wo ks; h ps://elec onics.hows u wo ks.com/4g2.h m
Pa s o MPEG-4 Pa s o MPEG-4; h ps://mpeg.chia iglione.o g/s anda ds/mpeg-4
Tabla de ecuencias 4G Tabla de ecuencias 4G; h p://www.gigahe z.es/ abla-de- ecuencias-
4g.h ml
Video Comp ession S anda ds – P os & Cons Video Comp ession S anda ds – P os & Cons;
h ps://www.mis alsolu ions.com/a icles/ ideo-comp ession-s anda ds-p os-cons/
Wha Is 5G and How Will I Make My Li e Be e ? Wha Is 5G and How Will I Make My Li e
Be e ?; h ps://gizmodo.com/wha -is-5g-and-how-will-i -make-my-li e-be e -1760847799
Wi eless Ne wo ks Wi eless Ne wo ks; h ps://www.uni e sidad iu.com/ ipos-de- edes-inalamb i-
cas-mas-comunes/, Access 29/08/2018
WLAN F equency Bands & Channels WLAN F equency Bands & Channels; h p://www.cable-
ee.ne /wi eless echnology/wi eless-lan/wlan- equency-bands-channels/
Bibliog aphy