ERASMUS PROJEKAT IZGRADNJE KAPACITETA NA POLJU VISOKOG OBRAZOVANJA

ERASMUS+ PROJEKAT IZGRADNJE KAPACITETA NA POLJU VISOKOG OBRAZOVANJA: DIGITALNO EMITOVANJE I ŠIROKOPOJASNE TEHNOLOGIJE (DBBT) ERASMUS+ CAPACITY BUILDING IN THE FIELD OF HIGHER EDUCATION PROJECT: DIGITAL BROADCASTING AND BROADBAND TECHNOLOGIES (DBBT) USVAJANJE STRATEGIJE KONTROLE KVALITETA QUALITY CONTROL AND MONITORING STRATEGY APPROVEMENT Universidad Politécnica de Madrid (UPM) September, 28 -29. 2016

OSNOVNI RADNI PAKETI – MAIN WORK PACKAGES WP 1 – Početak implementacije projekta – komparativna analiza studijskih programa - konsultacije WP 2 – Nabavka opreme, softvera i literature; metodoloske instrukcije za predavače WP 3 – Razvoj principa, modela i kurikuluma novih studijskih programa Ac. MS WP 4 – Razvoj principa, modela i kurikuluma novih studijskih programa Vac. Ms WP 5 – Implementacija novih studijskih programa – monitoring prve generacije studenata WP 6 – Razvoj plana kontrole kvaliteta, kontrola kvaliteta i praćenje rezultata WP 7 – Diseminacija (širenje) i upotreba rezultata WP 8 – Akreditacija novih studijskih programa; kreiranje plana akademske i finansijske odrzivosti WP 9 – Upravljanje projektom WP 1 – Start of project implementation– comparative analysis of studies programs – consultation WP 2 – Equipment purchase, software and literature; methodological instructions for teachers WP 3 – The development of principles, models and curricula of new study programs Ac. MS WP 4 – The development of principles, models and curricula of new study programs Voc. MS WP 5 – Implementation of new study programs – monitoring of first-generation students WP 6 – The development plan for quality control, quality control and monitoring of results WP 7 – Dissemination and the use of results WP 8 – Accreditation of new study programs; creating a plan for Ac. MS/Voc. MS and financial sustainability. WP 9 – Project management

DBBT ODBOR ZA OSIGURANJE KVALITETA DBBT QUALITY BOARD (QB) DBBT odbor za osiguranje kvaliteta radi na obezbedjenu visokog kvaliteta projekta i dobijenih rezultata kao i maksimizaciju uticaja projekta kroz uspešnu diseminaciju (širenje) i korišćenje. DBBT Quality Board works on securing the high quality of the project and of obtained results, as well as on maximising project impact through successful dissemination and exploitation. Članovi DBBT odbora za obezbedjenje kvaliteta – DBBT QB Members UPKM HTPSZ UNIBL UNIBI VISER SINGI UL UPM UTARTU VSB-TUO TVMREZA JPETV ATV Predrag Spalević Milan Mišić Jovica Bulović Atif Hodžić Amela Zeković Marina Marjanović Jakovljević Matevž Pogačnik Slobodan Bojanić Gholamreza Anbarjafari Shahab Miroslav Voznak Mustafa Skenderi Zoran Gaćinović Danko Matić ODGOVORNI PARTNER: HTPSZ – Visoka tehnička škola strukovnih sudija Zvečan

DBBT ODBOR ZA OSIGURANJE KVALITETA DBBT QUALITY BOARD (QB) Glavni zadaci DBBT odbora za osiguranje kvaliteta su: The main tasks of the DBBT QB are: • • Organizacija i održavanje sastanaka DBBT odbora za osiguranje kvaliteta; Razvoj metodologije za internu evaluaciju razvijenih studijskih programa u skladu sa nacionalnim standardima samovrednovanja*; Praćenje procesa validacije razvijenih kurikuluma na institucionalnom nivou; Vodjenje pripreme, usaglašavanja sa nacionalnim standardima i podnošenje dokumentacije vezane za nove programe Nacionalnoj Komisiji za Akreditaciju; Vodjenje pripreme za spoljnu evaluaciju novih studijskih programa; Vodjenje procesa studentske evaluacije novih studijskih programa; Podrška procesu spoljne evaluacije projekta; Analiza dugoročnih i kratkoročnih indikatora uticaja-efekata. • • Organisation and holding of the meetings of DBBT QB; Development of the methodology for internal evaluation of developed programmes in line with National standards of self-evaluation*; Monitoring of the process of the validation of developed curricula at institutional level; Guiding the preparation, harmonisation with national standards and submission of the documentation related to new programmes to National Commissions for Accreditation; Guiding the preparations for external evaluation of new study programmes; Guiding the process of students’ evaluation of new study programmes; Supporting the process of project’s external evaluation, Analysis of long term and short term impact indicators; *Methodology for internal evaluation of developed programs is expected to be developed by EU partners due to extensive experience and to be accepted by all QB members.

DBBT – RAZVOJ STRATEGIJE UPRAVLJANJA DBBT - DEVELOPMENT OF QC&M STRATEGY QC & M Strategija formalizuje pristup kojim će se pratiti; periodično meriti napredak i rezultati projekta i osigurati najveći mogući kvalitet projektnih aktivnosti, rezultata i ishoda i upravljanja projektom. Koncept QC/M strategije je organizovan u četiri dela, odgovarajući sledećim fazama: • Planiranje aktivnosti WP-a, • Implementacija i rezultati (delivables), • Monitoring Projekta / WP-a, • Poboljšanja projekta / WP. The QC&M Strategy formalizes the approach that will be followed; periodically measure the progress and results of it and to ensure the highest possible quality of the project activities, outputs and outcomes and project management. The QC&M Strategy concept is organised into four parts, corresponding to the following phases: • Planning the activities throughout WP’s, • Implementation and deliverables, • Project/WP's monitoring, • Project/WP's improvement.

ELEMENTI STRATEGIJE QC&M STRATEGY ELEMENTS Kvalitet implementacije projekta Quality of Project Implementation Interna kontrola i praćenje Internal Control & Monitoring Spoljna kontrola i praćenje External Control & Monitoring Kvalitet rezultata projekta Quality of project deliverables Kvalitet rezultata projekta Kvalitet upravljanja projektom Quality of project deliverables Quality of Project Management Kvalitet dokumentovanih rezultata/proizvoda Quality of document based deliverables Upravni Odbor Steering Committee Odbor za obezbedjenje kvaliteta Kvalitet DBBT sastanaka /dogadjaja Quality of DBBT Events - Meetings Kvalitet promotivnog materijala Quality of promotional material Kvalitet WEB sajta i ostalih elektronskih medija Quality Board Odbor za upravljanje projektom Project Management Committee Vodje Radnih Paketa WP Leaders Quality of WEB site and other electronical tools Vodje zadataka – autori rezultata Task leaders – deliverable authors Kvalitet upravljanja projektom Quality of Project Management

Kvalitet dokumentovanih rezultata/proizvoda Quality of document based deliverables U brojevima, odbor za osiguranje kvaliteta je odgovoran za obezbedjenje: 1 QC&M Strategije sa planom i rokovima koji precizno regulišu rad QB; 1 sintetizovani izvestaj/analizu o istrazivanju zainteresovanosti studenata za uvodjenje novog studijskog programa na osnovu 6 izveštaja WB partnera; 1 izveštaj o relevantnosti i kvalitetu novih studijskih programa na osnovu 6 izveštaja WB partnera; 2 sintetizovana izveštaja – tekući i finalni na osnovu 2 x 6 WB institucionalnih izveštaja; 2 godišnja izveštaja o obezbedjenju kvaliteta zajedno sa izveštajima o aktivnostima DBBT QB; 1 model upitnika za studentsku evaluaciju novih studijskih programa; 2 analize istraživanja uticaja i rezultata (tekuća i finalna pripremljene pre tekućeg i finalnog izveštaja) 6 sastanaka DBBT QB i 6 zapisnika sa ovih sastanaka, itd. . . In numbers, the QB is in charge f assurance/delivery of: 1 Quality Control and Monitoring Strategy with the timetable and deadlines that regulate precisely the work of the QB; 1 synthesis report/analysis on the survey performed how students like idea of introducing new DBBT master studies based on 6 WB institutional reports – WP 1; 1 report on the relevance and quality of new developed curricula – based on 6 internal evaluation reports one report per partner - each WB partner; 2 synthesis reports on new curricula development - intermediate and final, based on 2 x 6 WB institutional reports; 2 annual quality assurance reports, containing the results of the assessment of the quality of project results (curricula, material, trainings, OER, etc. ) with embodied DBBT QB activity reports; 1 questionnaire model for students' evaluation of new study programme – WP 5, 2 impact surveys and their results (intermediate and final, prepared before intermediate and final project reports) 6 meetings of the DBBT QB and 6 Minutes from these meetings, etc. .

Kvalitet dokumentovanih rezultata/proizvoda Quality of document based deliverables Zajednički format za sve dokumentovane rezultate treba da koriste svi partneri koristeći modele koji su dodati ovoj strategiji kao Aneksi: A common format form for all document deliverables (word document, power point presentations) is to be followed by all partners using templates, which are added to this Strategy as Annexes: • Annex A – Word document template (01_DBBT_QB_Strategy_Annex_A_ word document template) • Annex B – Power point presentation template (02_DBBT_QB_Strategy_Annex_B_ power point template) • Annex C – Attendance list template (03_DBBT_QB_Strategy_Annex_C_ attendance list template) • Annex D – Event evaluation form (04_DBBT_QB_Strategy_Annex_D_ evaluation form) • Annex E – Event report form (05_DBBT_QB_Strategy_Annex_E_ report form) • Annex F – Work progress report template (06_DBBT_QB_Strategy_Annex_F_ work progress report)

Kvalitet DBBT dogadjaja/sastanaka Quality of DBBT events/meetings Svi dogadjaji u okviru projekta treba da budu organizovani profesionalno. Organizatori treba da obezbede u adekvatnom vremenu celokupni paket informacija uključujući draft agendu, pozivno pismo i informacije o logistici (putni aranžman, mesto, preporuka hotela, itd). - Organizator sastanka vodi računa o procesu registracije (uključujući listu učesnika – Annex C) - Oragnizator treba da obezbedi vodjenje zapisnika sastanka - Za sve sastanke treba da budu pripremljeni upitnici o evaluaciji sastanka (Annex D) - Na osnovu upitnika organizator priprema izveštaj o sastanku (Annex E) - Power Point prezentacije treba du budu u okviru odgovarajućih modela (Annex B) All events within the project should be organised professionally. The organizers should provide in due time a full information package to the participants including the draft agenda, letter of invitation and a note on the logistics (informing about travel arrangements, venue, suggested hotels, etc. ). Time for preparation activities depends on the type of event. • The meeting organizers will take care of registration processes (including attendees list – Annex C) • The organizers will also ensure the recording of minutes of the meetings • In all events also feedback forms will be distributed among participants (Annex D) • The event reports related to feedback forms will be prepared by organisers (Annex E). • Power point presentation should be prepared using appropriate template (Annex B).

Kvalitet promotivnog materijala, web-sajta i elektronskih medija Quality of promotional materials, websites and other electronic tool • • Svaki partner je zadužen za dizajn promotivnog materijala. DBBT logo i vizualni identitet projekta treba da bude primenjen na svim promotivnim materijalima zajedno sa logom EU. UPKM je zadužen za uspostavljanje i ažuriranje DBBT web-sajta sa svim informacijama i materijalima primljenih od partnera. Svi partneri će promovisati DBBT projekt na svojm web-sajtovima i ostalim elektronskim medijima (Facebook, Twitter, Linked. In, novostima, itd) sa kratkim opisom projekta, logom i linkom za DBBT web-sajt. Sa ciljem bolje komunikacije rezultata projekta svi partneri će koristiti: • Each partner is responsible for design of promotional material. The design of the DBBT logo and visual identity of the project, should be applied to all promotional material together by EU Logo. UPKM will be responsible for setting up and maintaining the DBBT web-site with all information and materials received from project partners. All partners will promote DBBT project on their websites and other electronic tools (Facebook, Twitter and Linked. In profiles/groups, newsletters, etc. ) by providing short description of the project, logo and link to DBBT website. With the aim to effectively communicate the results of the project, the partners will use: • Annex K – News template in order (11_DBBT_QB_Strategy_Annex_K_ news template) •

Ostali modeli koji u sastavu strategije: Other templates are also provided: Za recenzente rezutata ukoliko je potreban drugi nivo kontrole kvaliteta: For reviewers of deliverables where the second level of quality control is required: • Annex G – Check list for review of deliverable (07_DBBT_QB_Strategy_Annex_G_ review of deliverable) Model za upravljanje rizicima: Template for risk management • Annex H – Risk monitoring sheet (08_DBBT_QB_Strategy_Annex_H_ risk monitoring sheet) Tabela za promene medju budžetskim kategorijama: Table for changes which occurred between budget categories • Annex J – Changes for budget categories (10_DBBT_QB_Strategy_Annex_J_ budget changes form)

Strategija obezbedjenja kvaliteta Quality assurance strategy Osiguranje kvaliteta u DBBT uključuje četiri nivoa kontrole kvaliteta (1) Autor proizvoda, vodja zadatka; (2) Recenzenta proizvoda – vodja radnog paketa, (3) Odbor za upravljanje projektom, i (4) Odbor za kvalitet. 1. Autor proizvoda, vodja zadatka • 1. nivo odgovara nivou aktivnosti. Prezentacija proizvoda i aktivnosti projekta su zajednička odgovornost vodje zadatka i njegovog/njenog tima, partnera uključenih u aktivnosti i odgovarajućeg lidera WP; 2. Recenzent proizvoda – vodja radnog paketa: • 2. nivo kontrole čine najmanje dva dodeljena recenzenata članova WP (zavisno od vrste proizvoda) koji nisu autori proizvoda. Recenzenti imaju 5 radnih dana da odgovore slanjem komentara koristeći kao model listu (Aneks G). The quality assurance in DBBT includes four levels of quality control (1) Deliverable author, Task Leaders (2) Deliverable reviewers - WP Leaders, (3) Project Management Committee, and (4) Quality Board. 1. Deliverable authors - Task Leaders: • The 1 st level corresponds to the activity level. The presentation of deliverables and activities of the project are a joint responsibility of the associated Task Leader and his/her team, partners involved in the activity and corresponding WP leader; 2. Deliverable reviewers – WP Leaders: • The 2 nd level of control is elaborated by at least two assigned reviewers of the WP (depends on the type of deliverable) who are not authors of the deliverable. The reviewers have 5 working days to respond by sending comments using the template for the quality assurance check list (Annex G).

Strategija obezbedjenja kvaliteta Quality assurance strategy 3. Odbor za upravljanje projektom (PMC): • 3. nivo kontrole se vrši na nivou PMC. Ako nacrt proizvoda nije prošao 2. nivo kontrole i postoje neslaganja između autora i recenzenata, PMC će preduzeti potrebne korektivne radnje kako bi se došlo do prihvatljivog proizvoda. 4. Odbor za kvalitet (QB): • 4. nivo kontrole vrši QB. QB je najviši nivo odlučivanja konzorcijuma koji donosi konačnu odluku o odobravanju glavnih proizvoda. Ako je proizvod prošao 2. i 3. nivo kontrole bez većih neslaganja, moguće je uključiti ih u projektnim izveštajima čak i ako je formalno odobrenje QB još uvijek čeka. 3. Project Management (PMC) level: • The 3 rd level control is done at the PMC level. If a draft deliverable has not passed the 2 nd level control and there are disagreements between the deliverable authors and the reviewers, the PMC will take the necessary corrective actions in order to come up with acceptable deliverables 4. Quality Board (QB) level: • The 4 th level control is carried out by the QB. The QB is the highest decision making body of the partnership that takes the final decision for the approval of major deliverables. It shall be possible to include a deliverable in the project reports even if its formal approval is still pending, if it has passed the 2 nd and 3 rd level of control without profound disagreements.

Interna kontrola novih studijskih programa Internal control of new study programmes Interno praćenje vršiće se od strane svih partnera uključujući samovrednovanje, prateći plan rada i radne pakete, budžet, sastanke PMC i QB i forme za praćenje i evaluaciju (Annex D). - Studentska evaluacija biće izvodjena na karju svakog semestra sa ciljem prikupljanja i analize podataka o razvijenim studijskim programima; - Inovirani i novi studijski programi biće akreditovani od strane Nacionalnih komisija za akreditaciju; - Priznanje na nacionalnom i medjunarodnom nivou biće postignuto kroz podsticanje programa mobilnosti studenata i profesora. Internal monitoring will be carried out by all partners, including self-evaluation by using work plan and WPs, budget tables, PMC and QB meetings, monitoring and evaluation form (Annex D). - Student evaluations will be performed each semester to collect and analyse data about developed study programmes; - Innovated and new study programmes will be accredited at National accreditation offices; - Recognition on national and international level will be achieved through encouraging students’ and teachers’ mobility programmes.

ESG standardi za spoljnu kontrolu i evaluaciju novih studijskih programa ESG standards for external kontrol and monitoring of the new study programmes Institucije (WB) treba da prodju spoljno obezbedjenje kvaliteta za nove studijske programe u skladu sa standardima ESG*. Procesi spoljnog obezbedjenja kvaliteta treba da budu pouzdani, korisni, unapred definisani, da se dosledno sprovode i publikuju. To uključuje: - Samovrednovanje ili ekvivalent; - Spoljnu proveru koja uključuje i posetu instituciji; - Izveštaj kao rezultat spoljne provere; - Dosledno praćenje. Institutions (WB) should undergo external quality assurance for the new study programmes in line with the ESG* standards. External quality assurance processes should be reliable, useful, pre-defined, implemented consistently and published. It includes • a self-assessment or equivalent; • an external assessment normally including a site visit; • a report resulting from the external assessment; • a consistent follow-up. * ESG - Standards and Guidelines for Quality Assurance in the European Higher Education Area document is available by link http: //www. enqa. eu/index. php/home/esg/ i sa prevodom na bosanski http: //www. enqa. eu/indirme/esg/ESG%20 in%20 Bosnian. pdf

ESG standardi za spoljnu kontrolu i evaluaciju novih studijskih programa ESG standards for external kontrol and monitoring of the new study programmes • • • Spoljna evaluacija po standardima ESG koja je obavljena profesionalno, dosledno i transparentno, osigurava njeno prihvatanje i uticaj. U skladu sa ESG standardima i usvojenom strategijom obezbedjenja kvaliteta, članovi QB koji nisu direktno bili uključeni u kreiranje novih studijskih programa biće zaduženi za evaluaciju istih. Za WB partnere to će biti prvenstveno EU partneri iz QB. External quality evaluation carried out professionally, consistently and transparently ensures its acceptance and impact. According to ESG standards and the adopted strategy of quality assurance, QB members who were not directly involved in the design of new study programs will be responsible for their evaluation. For WB partner those are going to be assigned EU partners from the QB.

External project control Spoljna kontrola projekta Sa ciljem verifikacije odgovarajuće implementacije DBBT projekta, trošenja sredstava projekat i postizanja visoko kvalitetnih rezultata biće izvršena spoljna provera DBBT projekta. Na osnovu podugovora, koordinator projekta DBBT UPKM biće odgovoran za ovaj proces. Pre spoljne provere, svi partneri DBBT konzorcijuma odgovorni su za podnošenje izveštaja o opštim podacima u odredjeno vreme koordinatoru UPKM! Spoljnu kontrolu projekta vršiće NEO i EACEA. In order to verify proper implementation of DBBT project, spending of the budget funds and achieving the high quality results, the external audit of DBBT project will be performed. Based on sub-contracting, Co-ordinating DBBT institution UPKM will be responsible for the process. Prior to external audit, all full partners in DBBT are responsible for delivery of institutional project related data in given time frame to UPKM! External monitoring of the project will be performed by NEO and EACEA.

External project control Spoljna kontrola projekta Kao što definisano Partnerskim ugovorima, partneri su dužni da podnesu četiri finansijska i dva tehnička izveštaja. U toku njihove revizije PC/PMC će uzeti u obzir sledeće kriterijume: - Uskladjenost troškova sa budžetom troškova; - Prihvatljivost troškova; - Ispravnost i potpunost svih pratećih dokumenata i overene kopije faktura; - Ispravnost obračuna i primenjenih kurseva; - Da su bilo kakve promene izmedju budžetskih kategorija do kojih je došlo opravdane i potvrdjene, itd. As it is defined in Partnership Agreement, there will be four financial reports of the partners and two technical reports. During their review, PC/PMC will take into consideration following assessment criteria: • Conformity of the expenditures with the budget of the project; • Eligibility of the expenditures; • Correctness and completeness of all supporting documents and certified copies of invoices; • Correctness of the calculations and applied exchange rates; • That any changes which occurred between budget categories are eligible and justified, etc.

Hvala na pažnji! Thank you for your attention!