22SQ-00017 – PRA Inc Submission
RECENT PROJECTS
| Canadian Inventory Surveys of Small Mobile Outdoor Power Equipment | ||||
| Environment and Climate Change Canada 2020-2022 |
Environment and Climate Change Canada (ECCC) wished to improve its understanding of the number and use of small mobile outdoor power equipment in Canada through national surveys of three groups that use such equipment: households; businesses; and landscaping and lawn maintenance companies. PRA was engaged to design, conduct, analyze, and report on surveys with three distinct groups: households, lawn maintenance companies, and businesses other than lawn maintenance companies. The survey of Canadian households was conducted using two methodologies: an online survey using a research panel (n=4,393) and a random-digit telephone survey (n=226). The survey of Canadian businesses was conducted by randomly phoning businesses and municipalities (excluding lawn maintenance companies and government organizations) developed from lists from Dunn & Bradstreet. Businesses were given the option of completing the survey by telephone or online. In total, PRA completed 1,804 surveys — 1,703 by phone and 101 online. The sample of lawn maintenance businesses was developed by pulling phone numbers and contact information for lawn maintenance companies from online sources, primarily through the Canada411 website using various search terms (i.e., lawn maintenance, lawn and garden, landscaping), as well as social media sites (LinkedIn and Facebook). To conduct the survey, PRA randomly phoned businesses, and for those that qualified, businesses were given the option of completing the survey by telephone or online. In total, PRA completed 850 surveys — 659 by phone and 191 online. PRA conducted detailed analysis of each of the surveys. PRA also prepared standalone reports for each of the surveys, and a final report that synthesized the findings from all three. |
|||
| Recreational Effort and Catch Survey | ||||
| Fisheries and Oceans Canada Annually since 2015 |
Fisheries and Oceans Canada (DFO) conducts an online survey of a random sample of fishing licence holders in British Columbia. When PRA was first engaged, DFO was looking to revamp its Recreational Effort and Catch Survey to be more user friendly, as it was collecting a complex series of information regarding the region in which fishing took place, the date, the equipment used, and the species caught (and released); all of which needed to be provided for an entire month. The goal was to provide respondents with a more interactive experience that would provide clickable maps and visual clues for species. Once the survey was updated, PRA managed the data collection process. DFO provided a random sample of licence holders; PRA then emailed an invitation to complete the survey. The invitation included a toll-free number that respondents could call to ask PRA questions. PRA sent reminder emails to non-responders (even if they had not fished in a month, they needed to log on to indicate that). PRA prepared the data file for delivery to the DFO. These tasks were then repeated each month. |
|||
| Gas Tax Fund Recipient Survey | ||||
| Infrastructure Canada 2021 |
The Gas Tax Fund (GTF) was launched in 2005 to provide predictable funding to municipalities to support environmentally sustainable municipal infrastructure. PRA was engaged to conduct a survey of the recipients of the fund. PRA designed and tested a survey instrument. We programmed the survey online and, using a database provided by Infrastructure Canada, sent an email invitation to recipients to complete the online survey. PRA achieved a 42% response rate (n=923). PRA analyzed the results and prepared a detailed report of the findings. |
|||
| Social Responsibility and Alcohol Consumer Study | ||||
| Manitoba Liquor & Lotteries 2020 |
PRA conducted a telephone survey using random-digit dialling from February 24 to March 25, 2020 with 400 Manitobans, 386 of whom had consumed alcohol in the past year, to assess their behaviours related to alcohol consumption, as well as their awareness of some of Manitoba Liquor & Lotteries’ social responsibility campaigns. PRA was responsible for the questionnaire design, conducting the survey, analysis, and reporting the findings. |
|||
| National Arts and Culture Sector Impact Survey | ||||
| Orchestras Canada 2020 |
This national online survey of arts and cultural organizations and practitioners was designed to understand the current state of the sector, as well as identify needs for it to recover post-pandemic. |
|||
| Strategic Planning Research | ||||
| Peel Regional Police 2019-2020 |
Peel Regional Police (PRP) engaged PRA to conduct three pieces of research: residential (n=1,200) and business community (n=400) surveys, which collected community attitudes and opinions on police-related issues and safety, providing input into strategic plans for PRP; an employee survey (n=746) to contribute to the strategic plan; and stakeholder (n=53) and youth (n=30) workshops to supplement the findings of the residential and business community surveys and provide further community stakeholder input into strategic plans. PRA worked closely with the PRP in the design of the surveys and the workshop guides. PRA prepared standalone reports for each of the pieces of research, and produced a presentation deck synthesizing the findings. Presentations were made by PRA to the management team at PRP as well as to the Police Board. |
|||
| Return to Work | ||||
| Workers Compensation Board of Manitoba (WCB) 2019-2020, 2022 |
PRA was engaged to help the WCB understand attitudes and behaviours towards the Return to Work program. PRA was involved in the survey design, data collection, and reporting. PRA conducted surveys with three groups to assess their perceptions of the Return to Work program and philosophies associated with the program: a survey of Manitobans (n=600), a survey of employers (n=206), and a survey of physicians (n=135). PRA analyzed and reported on each of the surveys, and developed a presentation that combined the results from all groups. This research was repeated in 2022. |
|||
| Canada Apprentice Loan (CAL) Program | ||||
| Economic and Social Development Canada 2018-2020 |
As part of the evaluation of the Canada Student Loans Program, PRA was engaged to conduct several surveys: a random sample of recipients of CAL (n=1,000), a random sample of apprentices who did not receive loans through CAL (n=850), and a survey of apprentices at various programs across Canada (n=800). PRA designed and conducted the survey. |
|||
| Diversity, Inclusion and Equity Workplace Evaluation Services | ||||
| YMCA-YWCA of Winnipeg 2022 |
The YMCA-YWCA wanted to conduct a survey with their workforce to better understand the diverse makeup and sentiments of their employees’ experiences working for the organization. In addition, the survey was intended to gauge subjects of reconciliation, equity, diversity, and inclusion. PRA was involved in all aspects of the research, including the design of the survey, programming the online survey, distributing email invitations, and analyzing and reporting on the results. Fifty-five percent of the staff (n=363) took part in the survey. |
|||
| 2020 Strategic Priorities and Budget Survey | ||||
| Halifax Regional Municipality (HRM) 2020 |
PRA conducted this online survey on behalf HRM. The goal of this survey was to understand where residents would like to see investments in municipal programs and services. Over 4,000 residents participated in the survey. |
|||
| Survey of Voters and Non-Voters | ||||
| Elections Manitoba Following each provincial election since 1999 |
PRA has conducted this research for Elections Manitoba following each provincial election since 1999. The research involves a random sample telephone survey of 800 eligible voters: 400 who chose to vote in the most recent election and 400 who did not. As part of this study, we measure trust of the electoral process and, in particular, trust in Elections Manitoba. |
|||
| Bill Affordability Research Services | ||||
| Manitoba Hydro 2016-2017 |
In 2015, the Public Utilities Board directed Manitoba Hydro to initiate a collaborative process to enhance the bill affordability programming it offers to low-income customers, overseen by a working group consisting of Manitoba Hydro representatives and other interested stakeholders. PRA was engaged to conduct research on bill affordability to support the collaborative process. Multiple methods were used in the research, including a literature and document review (including an environmental scan of bill affordability approaches in other jurisdictions); key informant interviews; a telephone survey of Manitoba Hydro customers; analysis of Manitoba Hydro administrative data; and quantitative modelling of rate options. |
|||
| Gaming Market Research | ||||
| Manitoba Liquor & Lotteries Corporation 2012 |
Manitoba Liquor & Lotteries engaged PRA to conduct a telephone survey of adult Manitobans. The objectives of this survey are to determine the percentage of Manitobans that play various gaming-related products, examine play habits, and determine awareness of various gaming options in Manitoba (aided and unaided). |
|||
| Egg Usage and Attitudes Research | ||||
| Egg Farmers of Alberta Annually since 2017 |
This annual survey involves 400 adult Albertans. The survey provides the Egg Farmers of Alberta with information on the public’s attitudes toward eggs and egg farming, identifying both strengths and weaknesses about the product and those who produce it. This study tracks results over time, and allows for the addition of topical questions that may run for a single year. PRA is involved in all aspects of this study, from question design to reporting. |
|||
| COVID Vaccine Survey | ||||
| Grey-Bruce Health Region 2021 |
The Grey-Bruce Health Region is located along the shore of Lake Huron and includes a mix of population centres, including rural and remote areas. PRA conducted a random sample (landline and cellphone) survey of 400 Grey-Bruce residents to understand their perceptions of and barriers toward receiving the COVID-19 vaccine. PRA assisted in the design of the questionnaire, conducted the survey from our Winnipeg call centre, coded and analyzed the data, and prepared a presentation-style report. This survey was designed to help the Health Region understand the attitudes toward the vaccine and implement messaging to help counteract misinformation. |
|||
| Protein Consortium Research | ||||
| Manitoba Agriculture 2020-2021 |
PRA was engaged by Manitoba Agriculture to conduct eight focus groups involving industry leaders and environmental representatives to understand the challenges and barriers to growing the province’s protein sector. These groups were conducted via Zoom, and each of the groups involved seven or eight participants. |
|||
| Evaluation of Manitoba’s Provincial Parks | ||||
| Parks Manitoba/Travel Manitoba 2020-2021 |
Travel Manitoba, in partnership with the Parks and Resource Protection Division (Parks Manitoba), wanted to develop a business case for a new provincial park model. As part of this case, PRA was hired to conduct several surveys with various stakeholder groups to assess current use, satisfaction, barriers to use, and interest in various enhancements. PRA worked with Travel Manitoba and Parks to develop several online surveys for the various stakeholder groups. These surveys were completed with the following number of stakeholders: about 3,000 general park users, 1,060 cottage owners, 1,655 Manitobans, 69 park businesses, and 18 park employees. PRA was responsible for overall project management and design, including survey design, sampling, conduct of the surveys, analysis, and reporting. PRA produced 12 separate reports examining various types of park users and non-users. |
|||
| Parent Survey of Child Care Needs Across Manitoba | ||||
| Communications Services Manitoba 2020 |
Communications Services Manitoba hired PRA to conduct a survey with 600 Manitoba parents or guardians of children 12 or younger in order to understand their child care needs. PRA was involved in all aspects of the survey, from the design of the questions and pretesting, to data collection, analysis, and reporting. The survey was conducted from our call centre in Winnipeg. The survey was programmed in our computer-aided telephone interviewing (CATI) system which is integrated into our online survey platform. The survey helped the government understand the needs of parents for various types of child care. |
|||
| Low Alcohol Beer Focus Groups | ||||
| Manitoba Liquor & Lotteries 2020 |
Manitoba Liquor & Lotteries wanted to conduct focus groups with consumers to better understand their perceptions, purchasing behaviours, and attitudes in regards to products with no or low alcohol. These focus groups were intended to help the corporation better understand purchase motivators and develop a marketing strategy to encourage growth within these categories. PRA conducted four focus groups, segmented by age and gender, with Manitobans who had purchased a no-alcohol or low-alcohol product at least a few times in the past year. These groups were conducted online using Zoom. |
|||
| Student Housing and Meal Plans at Post-Secondary Institutions | ||||
| The College Housing (Olds) Corp 2019-2020 |
The College Housing (Olds) Corp (CHOC) engaged PRA to analyze the student housing market among post-secondary institutions in Alberta. In particular, CHOC wanted to analyze both housing and meal plans offered at competitor institutions. This research was undertaken to examine the primary costs of residency at post-secondary institutions, including housing and meals. For housing, we used mostly secondary research (websites and other online public sources) to gather information on: types of student housing, focussing mainly on the types offered by CHOC; rates charged for student accommodations (e.g., rent); supplementary costs (e.g., application fee, deposit, parking, residence life fees, internet, etc.), and cooking facilities (e.g., community kitchens, in-unit kitchen). For meal plans, information was also gathered on: types of meal plans available (e.g., all-you-can-eat, pay-as-you-go, cafeteria/brand-name vendors); costs of meal plans; whether meal plans were mandatory or optional; and any speciality services (e.g., make-your-own stations, events, cooking lessons, etc.). This research involved 78 housing structures at 24 universities, mostly in Alberta. |
|||
| Stakeholder Surveys | ||||
| Tourism Nova Scotia 2019-2020 |
PRA was hired by Tourism Nova Scotia to conduct surveys of industry stakeholders to obtain their overall perceptions of the tourism industry, and their opinion regarding its success working towards its key objectives. In addition, using benchmark measures developed from the previous year’s survey, PRA completed a comparison analysis against the results of the current year. |
|||
| Club Card Segmentation Research | ||||
| Manitoba Liquor & Lotteries 2019 |
This study involved an online and telephone survey with Manitoba Casinos Club Card members. Working closely with Manitoba Liquor & Lotteries, PRA designed a survey instrument to understand the characteristics of various members. PRA programmed the survey online and in our computer-aided telephone interviewing (CATI) software. To ensure a representative sample, active Club Card Members with email addresses were sent an invitation to complete the survey online, while those without email were contacted by telephone. In total, over 4,600 members completed the survey. PRA analyzed and reported on the segments. |
|||
| Customer Values Assessment Study | ||||
| Manitoba Hydro 2018-2019 |
PRA was hired by Manitoba Hydro to conduct a customer values assessment study to determine the needs and wants of its customers. The research involved two phases: focus groups with customers in three communities and an online survey of Manitobans using PRA’s panel. The focus groups were used to identify potential drivers of customer value, and the survey of 1,000 Manitobans assessed core values and drivers of these values. |
|||
| Wine Segmentation Study | ||||
| Manitoba Liquor & Lotteries 2016-2017 |
As a follow-up to focus groups that PRA conducted for Manitoba Liquor & Lotteries, the corporation wanted to conduct segmentation analyses of the Manitoba wine market and wine consumers. Using the information gathered from the focus group research, Manitoba Liquor & Lotteries wanted to understand the size and the scope of various wine segments and the characteristics of each segment. This research was intended to help the corporation understand the sales potential of each segment, in addition to the demographics, purchase behaviours, lifestyles, habits, and attitudes of each segment. Working closely with the corporation, PRA designed a survey instrument. PRA then programmed the survey in its computer-aided telephone interviewing (CATI) system and pretested it. Over a six week period, PRA conducted a survey with 1,000 Manitobans who drink wine. PRA analyzed and reported on the findings. |
|||
| Meeting Facilitation | ||||
| Efficiency Manitoba Ongoing since 2020 |
Efficiency Manitoba engaged PRA to facilitate meetings with its Energy Efficiency Advisory Group. This includes developing a guide for each meeting, facilitating the discussion, and preparing meeting minutes. |
|||
| Manitoba’s Energy Future | ||||
| Dunsky Energy + Climate Advisors 2021-2022 |
Dunsky Energy + Climate was engaged by the Manitoba government to produce a framework for Manitoba’s energy future. Dunsky hired PRA to conducted workshops with stakeholders to get their input. PRA developed an online recruiting platform, developed the sessions guide, facilitated the sessions, and provided a detailed report. The workshops involved a presentation of the work to date, question and answer sessions, and breakout sessions so a smaller number of participants could more intensively review key issues. Two groups involving 36 stakeholders were held to get initial input into the design of the framework. Stakeholders were invited to a second set of workshops three months later where Dunsky presented initial findings, including modelling of the ideal future state and policy options. Two follow-up workshops were held involving 52 stakeholders. PRA facilitated these groups and prepared a report on their outcomes. |
|||
| Integrated Resource Planning Workshops | ||||
| Manitoba Hydro 2022 |
As part of the larger process of the Integrated Resource Planning initiative, Manitoba Hydro wished to conduct workshops with various stakeholder representatives. PRA was engaged to support this process, including assisting with recruitment of participants, and hosting and facilitating the workshop sessions online. This process involved six workshops conducted with representatives from various stakeholders. In total, 118 individuals attended the workshops. PRA worked with Manitoba Hydro to craft the workshop agenda, which involved a presentation of findings to date, question and answers sessions, and breakout sessions to critique draft key inputs and possible modelling scenarios. Following the session, PRA sent attendees an email with a link to an online survey that asked about their workshop experience and what could be done better. PRA produced a variety of reports from these sessions, including transcriptions, a summary report, and a detailed report including recommendations on how to improve such workshops in the future. |
|||
| Focus Groups on Persistence in Studies for the Evaluation of the Canada Student Loan Program | ||||
| Employment and Social Development Canada (ESDC) 2020-2021 |
PRA was engaged by ESDC to conduct focus groups with students who had received a Canada Student Loan and were currently attending a post-secondary institution. Working with ESDC, PRA designed a moderator’s and recruiting guide. PRA recruited eight to 10 participants for each of the eight groups. PRA conducted the groups online using Zoom. Participants received an honorarium for participating in the two-hour group. PRA prepared a detailed report on the findings. |
|||
| COVID-19 Impact and Vaccine Focus Groups | ||||
| University of Manitoba 2020 |
In December of 2020, PRA conducted 12 focus groups in four cities (Vancouver, Winnipeg, Ottawa, and Toronto) involving 82 men and women. In each city, the groups were segmented based on age (18‐34, 35‐54, and 55 and older). The groups investigated participants’ trust in public health authorities, communications of public health guidelines, and acceptance of COVID-19 vaccines and priority groups. The research was also used to identify information gaps and methods to encourage behaviours. The results were to help inform decisions of public health offices in several provinces. |
|||
| Impact of COVID-19 on Youth | ||||
| Communications Services Manitoba 2020 |
Communications Services Manitoba hired PRA to undertake focus group research to understand young Manitobans’ attitudes, behaviours, and experiences with the COVID-19 pandemic. In addition, the groups were used to assess potential advertising and understand the mediums youth use. PRA conducted four focus groups, two with people 18 to 24 years of age and two with high school students. The groups were segmented by gender. PRA worked with the client to design the moderator’s guide, and PRA recruited the participants, conducted the groups online via Zoom, analyzed the findings, and prepared a report. |
|||
| Forest Management Facilitation | ||||
| Communications Services Manitoba 2020 |
PRA was hired by Communications Services Manitoba to facilitate two online webinar meetings regarding the Clean Environment Commission’s Report on Manitoba’s Forest Management Plan Approval process. These sessions involved 30 to 40 participants. |
|||
| Indigenization Project Research | ||||
| Winnipeg Art Gallery 2020-2021 |
PRA was hired by the Winnipeg Art Gallery (WAG) to conduct focus groups with local Indigenous Leaders, artists, and Inuit residents to gather feedback about the WAG and its framework. In addition, PRA conducted a survey with Indigenous people in Manitoba, as well as one-on-one telephone interviews with Indigenous representatives from various organizations. |
|||
| Community Consultation on Equity, Diversity and Inclusion | ||||
| University of Manitoba 2020 |
The University of Manitoba’s Equity, Diversity and Inclusion (EDI) taskforce hired PRA to conduct focus groups with university community members to gain insight into ways the university can reduce barriers and promote EDI principles throughout its campuses. A total of seven focus groups were held with university students, staff, and faculty members. |
|||
| Safe Work Ad Testing | ||||
| Workers Compensation Board/SAFEWork Manitoba Annually, 2010- 2019 |
On an annual basis, PRA would focus test ad campaigns for the WCB, most often on the theme of safe work. The most recent ad testing involved two focus groups segmented by age (18 to 34 and 35 to 55), testing TV creatives and three outdoor ads. PRA designed the guide, recruited participants, and produced a report on the findings. |
|||
| Market Research to Assess Potential for Rebundling/Simplification of Natural Gas Bill | ||||
| Manitoba Hydro 2020 |
PRA was hired by Manitoba Hydro to conduct six focus groups to measure natural gas customer perceptions of and preferences for simplifying natural gas bills by rebundling gas and delivery rate components on their energy bill. Of these six groups, four groups were with residential customers and two groups were with business representatives. In total, 44 people participated in these six groups. |
|||
| Keystone Agricultural Producers Focus Groups | ||||
| Keystone Agriculture Producers 2019-2020 |
PRA was hired by Keystone Agricultural Producers (KAP) to undertake two focus groups to better understand the needs of its members as well as what might encourage young farmers to become KAP members. PRA recruited, conducted, and prepared a report on the focus groups. |
|||
| Ad Testing | ||||
| Manitoba Public Insurance 2019 |
This research involved focus testing three different TV ads to understand how well they performed in delivering key messages and whether these messages resonated with participants. PRA designed a recruiting guide and moderator’s guide for approval. PRA randomly recruited participants, ensuring they met the criteria and segmenting them into four groups based on age and gender. It was a challenging recruitment, as participants had to admit to distracted driving (e.g., using a handheld cellphone). The groups were moderated by a senior researcher from PRA. A week after the completion of the groups, PRA prepared and presented the findings from the research. |
|||
| Cannabis Follow-Up Survey with Youth | ||||
| Communications Services Manitoba 2018-2019 |
Communications Services Manitoba hired PRA to undertake focus groups to understand attitudes, behaviours, and messaging around the risk of cannabis use with youth aged 16 to 25. PRA designed the recruiting and discussion guides, recruited the participants, and moderated the focus groups. In total, three groups were held (n=25). |
|||
| Ad Testing | ||||
| Canadian Electrical Association 2019 |
PRA was engaged to conduct two focus groups segmented by age (18 to 40, 41 and older). Participants were shown six sets of potential advertising. The groups were structured to allow participants to independently react to each set of advertising before discussion began. PRA was involved in all aspects of this research, from design to reporting. |
|||
| Focus Groups on Efficiency Manitoba Branding | ||||
| Manitoba Hydro 2018 |
In November of 2018, PRA conducted three focus groups with Manitoba residents, segmented by age (n=26). The purpose of these groups was to test possible branding images for the newly developed Efficiency Manitoba corporation. |
|||
| Cannabis Awareness Concept Focus Groups | ||||
| Liquor and Gaming Authority of Manitoba 2018 |
PRA was hired by the Liquor, Gaming & Cannabis Authority of Manitoba to conduct two focus groups with adults Manitobans in order to collect data on cannabis awareness and consumption habits, as well as to test messaging about cannabis limits and safer cannabis use strategies. PRA recruited, conducted, and prepared a report on the focus groups. |
|||
| Take-up of Guaranteed Income Supplement | ||||
| Economic and Social Development Canada 2017-2018 |
This research involved focus groups in six Canadian cities (Vancouver, Winnipeg, Toronto, Ottawa, Montréal, and Halifax). Working with the client, PRA developed a recruiting guide and moderator’s guide, and once approved, had them translated into French. The greatest challenge of this research was building sample and recruiting participants. In each city, PRA worked with local community organizations to identify potential participants. The groups were held in person with a goal of having three to five participants attend each. After each group, PRA transcribed the discussion and prepared a summary. Upon completion of all groups, PRA prepared a report synthesizing the findings from the six groups. |
|||
| Evaluation of the Canada Research Chairs Program | ||||
| Social Sciences and Humanities Research Council of Canada 2021 (ongoing) |
The Social Sciences and Humanities Research Council of Canada (SSHRC) Evaluation Division is leading the 20th year evaluation of the Canada Research Chairs Program (CRCP). SSHRC engaged PRA to conduct the evaluation, which included a document review, a literature review, case studies, a survey, and key informant interviews (n=45). The interview guides used were tailored to the seven categories of stakeholders interviewed. Interview guides were also linked to the evaluation questions and indicators to ensure that all relevant evaluation issues were covered. Interviews were 30 to 60 minutes in length. PRA prepared a standalone report on the interviews, which will be integrated into the final report. |
|||
| Reuse of Space Technology | ||||
| Canadian Space Agency 2022 |
This research investigated the reuse of technologies funded by the Canadian Space Agency (CSA), as well as spatial data available from CSA. PRA conducted interviews with 105 of the 143 organizations that had received funding in the form of contracts, grants, or contributions for 987 projects. Each interview was conducted through video conferencing or by telephone. |
|||
| Performance Measurement | ||||
| Canadian Intergovernmental Conference Secretariat Annually since 2016 |
Since 2016, the Canadian Intergovernmental Conference Secretariat (CICS) has hired PRA to conduct telephone interviews with a sampling of the people involved in planning one or more events in the previous year. In 2022, 25 individuals were interviewed. PRA prepares a detailed report based on their interviews and, as possible, compares the results with the previous two years’ findings. |
|||
| Evaluation of the Skilled Trades Awareness and Readiness (STAR) Program | ||||
| Employment and Social Development Canada 2021-2022 |
The STAR Program was launched in fiscal year 2018-19 and targets all Canadians, particularly those facing barriers to entering the trades, such as youth, women, Indigenous Peoples, newcomers, persons with disabilities, and racialized communities, including Black Canadians. PRA was engaged to support this evaluation by conducting 31 interviews with program officials and funding recipients. The result of these interviews was a detailed report linking the findings to key evaluation questions. |
|||
| Mid-Term Horizontal Evaluation of It’s Time: Canada’s Strategy to Prevent and Address Gender-Based Violence | ||||
| Women and Gender Equality Canada (WAGE) 2021-2022 |
WAGE hired PRA to conduct this evaluation, which involved a document and data review, a literature review, focus groups, and key informants interviews (n=91). PRA prepared technical reports on each line of evidence, and synthesized the results in to a final report. |
|||
| Saskatchewan Centre for Patient-Oriented Research (SCPOR) | ||||
| University of Saskatchewan 2020-2021 |
PRA was engaged to conduct this evaluation using multiple lines of evidence, including a document and data review, a literature review and environmental scan, interviews with 38 individuals, and a survey of stakeholders (n=128). PRA prepared report for each line of evidence, and created a final evaluation report that synthesized these findings. |
|||
| Evaluation of Victoria Early Resolution Model | ||||
| BC Attorney General 2020-2021 |
As part of this evaluation, PRA conducted interviews with 38 internal and external stakeholders as well as conducted a survey (online and by telephone) with 145 clients. |
|||
| Document Review and Interviews for the Evaluation of the Canada Pension Plan Service Improvement Strategy | ||||
| Employment and Social Development Canada (ESDC) 2021-2022 |
PRA was engaged by ESDC to conduct two supporting tasks for a larger evaluation. These included a document review and key informant interviews with 38 individuals. PRA prepared reports for both the review and the interviews, linking the findings to the evaluation questions. |
|||
| Evaluation of the COR Program | ||||
| Alberta Labour 2018 |
PRA conducted two surveys: one with 800 Certificate of Recognition (COR) holders and one with 400 non-COR holders. The surveys were supported by 21 key informant interviews and 12 focus groups with business representatives. PRA was responsible for designing the guides and conducting the qualitative research. |
|||
| Graduate Survey | ||||
| Saskatchewan Ministry of Advanced Education 2021-2022 |
The Saskatchewan Ministry of Advanced Education (the Ministry), in collaboration with post-secondary institutions and organizational partners, commissioned a research project to gather information on individuals who graduated from a post-secondary institution in the calendar year 2019. The intention of the survey was to measure graduates’ levels of satisfaction with their education and overall post-secondary experiences, sources of financing for their education, levels of education-related debt, and pre-and post-graduate mobility, as well as their education and employment outcomes. PRA, the Ministry, and participating institutions reviewed the questionnaire and made changes to enhance the flow of the survey and improve the face validity of questions. PRA coordinated with institutions to have student contact data transferred securely. All files were transferred via PRA’s secure FTP site. PRA prepared letters to graduates to inform them of the survey and gave them information to complete the survey online. In addition to the letter, the process for surveying graduates involved several steps: reminder emails, social media, and phone surveys. Overall, 5,485 graduates completed the survey, yielding a 42% completion rate with a theoretical error rate of ± 1.0%. PRA analyzed the data, examining it overall, by subgroups, and by institution. PRA prepared a detailed methodology report and a detailed findings report. The latter examined the results overall and compared findings with those for earlier surveys (e.g., 2014, 2009) and by institution. |
|||
| Client Feedback Program | ||||
| CONVIRON Annually since 2016 |
Working with CONVIRON, PRA conducted a number of one-on-one interviews with clients and focus groups with CONVIRON staff to understand the key drivers of satisfaction. Based on this information, PRA designed a short survey that is sent to clients shortly after their purchase and installation of an environmental unit. On a monthly basis, PRA receives a list of customers from CONVIRON, emails them an invitation to complete the survey online, and follows up with non-responders by email and telephone to ensure a high response. Monthly, PRA produces a summary report on the results, comparing them with the results over time. |
|||
| Student Surveys | ||||
| Canadian University Survey Consortium (CUSC) Annually since 1999 |
Since 1994, CUSC has coordinated surveys of students attending member institutions and facilitated sharing the survey data among its member institutions. PRA has been conducting the survey for CUSC since 1999. Since 2009, the survey has been conducted online with an initial invitation containing a unique link and two follow-ups to non-responders. Each university supports the study by generating a sample of qualifying students. In some cases, institutions provide all qualifying students, while others provide a random sample of students. PRA works closely with each of the participating universities to ensure that their sample meets the criteria of the study (approximately 25 to 40 institutions annually). The number of students invited to participate ranges from 100 to over 5,000 depending on the institution. PRA is responsible for managing the online survey. This involves liaising with the participating universities, preparing the introductory and reminder emails to students, and responding to student questions about questionnaire content, as well as technical questions about the online survey. The survey is offered in both English and French. Students are contacted by email and the survey is online for approximately four months. Annually, approximately 15,000 to 20,000 students complete the survey. To ensure that the sample is representative of the population of graduates, PRA weights the data so that each institution represents the correct proportion of students overall. PRA produces an overall report in both English and French, with tables that present the results of the survey as a whole and by institution size. In addition, PRA produces two individual reports for each of the participating institutions: a summary report that highlights key findings and an overall report that contains the detailed findings. |
|||
| Citizen Satisfaction Survey | ||||
| City of Winnipeg 2015-2018, 2020-2022 |
Annually from 2015-18, and again in 2020, 2021, and 2022, PRA conducted a survey of 600 Winnipeggers via random-digit dialling. The survey included approximately 90 items focussed on their satisfaction with the City’s services. PRA was also responsible for analyzing data, and reporting and presenting results to the City. |
|||
| Acute Care Experience Survey Data Collection and Analysis | ||||
| New Brunswick Health Council 2018-2020 |
The New Brunswick Health Council (NBHC) has developed a model to facilitate an understanding of the complexities of the health care system. It involves examining health service quality based upon components of the health care system: primary health, acute care, supportive/specialty care, and hospice/palliative/end-of-life care. To improve the quality of client-centred services, the NBHC enlisted PRA to survey the citizens of New Brunswick regarding their experiences with acute care services. Acute care survey results were publicly reported by the NBHC in 2010 and 2013. This evaluation was the administration of the NBHC’s third survey on acute care in New Brunswick. |
|||
| Satisfaction with Police Services | ||||
| University of Regina 2019 |
The University of Regina contracted PRA to conduct phone surveys of 1,200 residents in cooperation with local police services in four areas of Saskatchewan. The areas to be surveyed consisted of Regina (n=450), Estevan (n=250), Weyburn (n=250), and the rural area in southeast Saskatchewan surrounding Estevan and Weyburn (n=250), each with specific quotas representative by age and gender. There were also quotas by police division for the Regina Police Service. The purpose of this study was to solicit residents’ opinions about the Regina Police Service. PRA reviewed the survey instrument and suggested modifications, pretested the questionnaire, conducted the survey, and provided the results. The surveys were conducted by random-digit dialling, using a mix of landline and cellphone sample. PRA completed field work for all four regions and provided data to the University of Regina. The survey focussed mainly on the public perception of their local police service, including their satisfaction with various aspects of service. |
|||
| Liquor Satisfaction Study | ||||
| Manitoba Liquor & Lotteries Annually since 2015 |
Manitoba Liquor & Lotteries engaged PRA to conduct a quarterly telephone survey of 450 adult Manitobans who had purchased alcohol from a Liquor Mart, beer vendor, rural liquor vendor, or private wine store in Manitoba in the past 30 days. PRA prepares a report after each quarter comparing results to the previous four quarters, and annual results back to 2015. The report highlights changes over time as well as differences among demographic subgroups. |
|||
| Member Satisfaction Survey | ||||
| Steinbach Credit Union Annually since 2018 |
PRA been conducting this monthly survey of SCU members since April 2018. The survey instrument was significantly revamped on advice from PRA in that year and the questions are reviewed annually to ensure their ongoing relevance. Each month, PRA contacts members by telephone asking them to complete the survey either online or by phone. The goal is to complete a 150 surveys per month. PRA prepares reports twice a year, combining two quarters’ worth of data (n=900) and comparing the current results with those completed in earlier quarters. |
|||
| Post-Election Surveys | ||||
| Elections Manitoba Following each provincial election since 1999 |
Following each provincial election, PRA conducts a survey of the public to understand their satisfaction with the various aspects of the conduct of the election. Originally, this survey was conducted by phone, but since 2016, the survey has relied on PRA’s online panel to achieve a sample of 600 eligible voters. |
|||
| Citizen Satisfaction Research | ||||
| Region of Niagara 2018 |
The Regional Municipality of Niagara selected PRA to assume responsibility for its citizen satisfaction research. PRA reviewed the previous citizen survey, updating the questionnaire to account for new areas of focus, and making recommendations as to how the survey questions could be made clearer and the flow of questions more intuitive. PRA generated a random sample of landline and cellphone numbers in the Niagara Region. PRA conducted 1,200 telephone surveys stratified by the 12 municipalities that make up the Region. As well, minimum quotas were set by gender and age. PRA conducted three focus groups with citizens to better understand some of the results of the survey research, and investigate how to improve communication from the Region to its citizens. PRA designed the recruiting and discussion guides for the groups, working closely with the Region. PRA conducted three in-person focus groups segmented by age. PRA prepared reports for the survey and focus groups, synthesizing the findings into a single presentation that was delivered to the communication team, the municipal department heads, and the regional council. |
|||
| Citizen Satisfaction Survey | ||||
| City of Winnipeg 2015-2018, 2020-2022 |
Annually from 2015-18, and again in 2020, 2021, and 2022, PRA conducted a survey of 600 Winnipeggers via random-digit dialling. The survey included approximately 90 items focussed on their satisfaction with the City’s services. PRA was also responsible for analyzing data, and reporting and presenting results to the City. |
|||
| Emergency Department Survey | ||||
| Health Quality Council of Alberta Annually since 2016 |
PRA was hired by the Health Quality Council of Alberta (HQCA) to conduct the Emergency Department Patient Experience of Care Survey. The participants are drawn from a list of 16 emergency departments within the HQCA boundaries. PRA is to survey 40 participants per facility biweekly, totalling 640 every two weeks (16,640 annually). The survey gathers patients’ experience during their emergency department visit and satisfaction with the outcomes. |
|||
| Customer Experience Survey | ||||
| Manitoba Public Insurance Annually since 2019 |
On a monthly basis, Manitoba Public Insurance provides PRA a list of customers who had an interaction with the Corporation, its brokers, or agents. The survey gathers customer experience and satisfaction with various aspects of these interactions. |
|||
| Survey of Graduates | ||||
| New Brunswick Post-Secondary Education Training & Labour Annually since 2017 |
This survey involves a follow up with graduates from post-secondary institutions in New Brunswick. In investigates their experience with their program and satisfaction with various aspects of their training. |
|||
| Graduate Satisfaction and Employment Survey | ||||
| Red River College Annually since 2015 |
PRA supports Red River College’s efforts to follow up with graduates to understand their satisfaction with their college experience. |
|||
| Survey of Members | ||||
| Civil Service Superannuation Board (CSSB) 2018 |
PRA worked closely with the CSSB to design a survey that would meet their needs. PRA was also responsible for the data collection for this online survey. In total 6,476 members responded. PRA cleaned and coded the data, and prepared a detailed report that examined results overall, as well as statistically significant differences by type of member. |
|||
| Casino Mystery Shopping | ||||
| Manitoba Liquor & Lotteries Quarterly since 2015 |
PRA has been conducting mystery shops of Winnipeg casinos since 2015, with the latest being the 22nd series of shops. These mystery shops are designed to have shoppers interact with eight different types of casino staff, assessing their appearance, greeting, and overall interaction, as well as the overall cleanliness of the casino and visibility of responsible gaming and event signage. |
|||
| Liquor Mart Mystery Shopping | ||||
| Manitoba Liquor & Lotteries Quarterly since 2015 |
Each quarter, PRA conducts mystery shops of Liquor Marts and rural liquor vendors. Each quarter involves two distinct types of shops: one shop for customer service, examining such things as appearance, information, promotion, greeting, and so forth; and the other for social responsibility, which tests to see if young adults are asked for their ID. Each quarter, approximately 50 customer service shops are completed throughout the province and about 70 social responsibility shops are completed (including both onsite and home delivery). Quarterly, PRA produces a report scoring Liquor Marts and rural vendors on their performance, and compares current results with early shops. |
|||
| Onsite mystery shopping | ||||
| Winnipeg Airports Authority (WAA) Annually since 2016 |
The WAA engaged PRA to conducted onsite mystery shopping of the Winnipeg airport’s food, beverage, and retail outlets. The mystery shopping takes place quarterly with approximately 50 shops being conducted at various times of day throughout the period. PRA produces a tracking report that shows the scores of each outlet type by the key indicators. |
|||
| Creatives Testing | ||||
| Manitoba Egg Farmers Annually since 2001 |
Annually, Manitoba Egg Farmers tests various creatives that will be used to support its members and egg production. These focus groups normally occur twice a year and involve testing TV, print, and digital creatives. Annually, four groups are conducted. PRA is responsible for the design of the recruiting and discussion guides, recruiting of participants, conducting the focus groups, and preparing the reports. Traditionally, these groups are held in person. However, as of 2020, the groups moved online using Zoom. The creative is then used in various campaigns, and we track awareness of the various media and the messaging through use of our online panel. PRA is involved in all aspects of the research, from design through to reporting. |
|||
| Evaluation of the Nicotine Replacement Program | ||||
| Manitoba Tobacco Reduction Alliance (MANTRA) 2016-2022 |
This evaluation involved a number of activities. PRA was engaged to design an evaluation that would allow MANTRA to understand the impact of providing free nicotine replace therapy (NRT) to individuals. Working closely with MANTRA, the Winnipeg Regional Health Authority, and Manitoba Health, PRA developed pre- and post-surveys and focus group and interview guides. Smokers were given a prescription for free-NRT. PRA would follow up with a pre-survey to understand their smoking behaviour and attitudes before using the NRT, and then one-year later, PRA would follow up to understand participants’ current smoking behaviour. In addition, PRA conducted focus groups and interviews with health care providers at the end of the program to understand the impacts of it on their practices. Reports were prepared at each stage of the research, as well as a final synthesis report and presentation. |
|||
| Well-being and Experience (WE) Study | ||||
| University of Manitoba 2017 (ongoing) |
The overall objective of the WE study is to collect quantitative data to learn more about the health, well-being, and experiences of adolescents, parents, and families in Manitoba. PRA was engaged to recruit parents and their adolescent children (14 to 17 years of age) and to administer separate surveys to a parent and child in person. PRA first piloted this study to understand the challenges of finding participants who met the criteria. In the end, the study used a combination to recruit participants, including random telephone calling, referrals, social media/advertising, and on-site intercepts. The surveys were completed online but on-site to ensure the parents and children did them separately and the child was not coached. Parents and children were paid an honorarium for their time. In total, PRA completed surveys with 1,000 parents and 1,000 surveys with adolescents. Since the initial survey, PRA has recontacted adolescents to complete a follow-up survey in 2019 (n=746) and in 2020 (n=657), and is currently conducting a follow-up survey with these now young adults. In 2021, PRA also did a follow-up survey with parents (n=741). |
|||
| Pretest And Post-Test: Survey of Community Members | ||||
| University of Alberta 2011-2013 |
The University of Alberta and Centre for Health Promotion Studies were exploring the potential impact of the Strathcona County Open Spaces and Recreation Facility Strategy (OSRFS) on health and health equity. They conducted a two-part study using telephone surveys (one pretest and one post-test survey) of community members in Strathcona County and comparing their results to community members in Spruce Grove/Stony Plain/Parkland County (the Tri-Region area). PRA was engaged to conduct both the pretest and post-test surveys. |
|||
| Communication with Wait Listed Patients | ||||
| Communications and Engagement Manitoba 2022 (ongoing) |
The Diagnostic and Surgical Recovery Task Force engaged PRA to conduct an environmental scan to understand the current state of communications with patients on waitlists. In addition, this project will involve a survey of the public and focus groups with wait list patients. |
|||
| Evaluation of Medication Safety Activities | ||||
| Institute for Safe Medication Practices Canada (ISMPC) 2020-2021 |
The evaluation focussed on the relevance, usefulness, and effectiveness of the products/services offered by ISMP Canada and their associated risk reduction and financial impact (i.e., value-for-money), as well as ISMP Canada’s ability to leverage impact through collaboration and engagement. PRA conducted the evaluation, which included four lines of evidence: a document, literature, and data review; key informant interviews with organization representatives (n = 14) and previous ISMP students (n = 3); an online survey of stakeholders (n = 734); and case scenarios highlighting ISMP Canada’s influence on improvements in health care practice (n = 6). |
|||
| Environmental Scan of Cultural Leadership Programs & Evaluation of the CCA International Leadership Initiatives | ||||
| Canada Council For The Arts (CCA) 2020-2022 |
This needs assessment focussed on understanding the current cultural leadership programs. While the programs focussed on the issue of supporting cultural leadership by building capacity and fostering inclusion, this research was to evaluate the success as well as identify gaps. The research involved both secondary (e.g., literature review, document review, and environmental scan) and primary research (i.e., interviews and focus groups). The environmental scan included review of the literature as well as a scan of 430 programs. For each line of evidence, a report was prepared by PRA, and findings were also synthesized into a final report. |
|||
| GBA+ of National Engineering licensure Assistance and Employment Awareness Programs | ||||
| Engineers Canada 2020-2021 |
Engineers Canada hired PRA to analyze the current national licensure assistance programming and employer awareness programming provided by the 12 provincial and territorial engineering regulators, using a Gender-based Analysis Plus (GBA+) lens, and an environmental scan to identify best practices. The results of the research are being used to guide Engineers Canada’s work with regulators help support the strategic priorities of recruiting and retaining more women in the engineering field, and promoting diversity and inclusion so that the profession more closely reflects society. |
|||
| Evaluation of Nanotechnology Program | ||||
| Alberta Innovates 2020-2021 |
This evaluation included several lines of evidence, including a document and data review, key informant interviews, a stakeholder survey, and an environmental scan. The environmental scan examined similar facilities in Canada and internationally. This evaluation resulted in separate reports for each line of evidence as well as an overall synthesis report. |
|||
| Workplace Safety Climate Survey | ||||
| SAFE Work Manitoba 2015 |
This research involved the development of a short survey that could provide workplaces with a method of measuring their safety climate. Such a survey would allow SAFE Work Manitoba and the workplace itself an understanding employees’ attitudes and behaviour when it comes to safety. It would provide SAFE Work Manitoba with a leading indicator of potential safety problems, and allow workplaces to proactively address safety issues that they may not have been aware of. It involved an environmental scan of the literature, focus groups, a pilot survey, and reporting on each line of evidence. |
|||
