Findings from the
RSA Region V CRP-RCEP at Illinois Activity Questionnaire
October 2004
Ongoing or formative evaluation of RSA Region V CRP-RCEP activities is important and valued for program improvement and effectiveness. This evaluation report describes the third round of data collection from the target audience of community rehabilitation practitioners in the RSA Region V six-state area of Illinois, Indiana, Michigan, Minnesota, Ohio, and Wisconsin. Of the respondents who submitted their contact information, six were from Wisconsin, eight from Illinois, six from Minnesota, three from Ohio, one each from Michigan and Indiana. The organization of this report is based upon the five questions. [Two surveys to gather information on training and organizational needs were disseminated via the RSA Region V CRP-RCEP newsletter, Around the Region, in the November 2003 and Spring 2004 issues. Evaluation data is always collected and analyzed on individual trainings.]
Introduction
- A brief questionnaire was disseminated via the Summer 2004 issue of the newsletter, Around the Region [see http://www.ed.uiuc.edu/illinoisrcep/resources/newsletter.htm] and the CRP-RCEP listserv to solicit feedback regarding CRP-RCEP activities in five broad areas. The mailing list for the newsletter is approximately 2100 and the subscriber list for the listserv is approximately 360. To encourage people to participate, we offered a $25.00 discount on one RSA Region V CRP-RCEP training and entry into a drawing for the following publication (three winners): Luecking, R.G., Fabian, E.S., & Tilson, G.P. (2004). Working relationships: Creating career opportunities for job seekers with disabilities through partnerships. Baltimore, MD: Paul H. Brookes Publishing Co. Deadline for receipt of completed questionnaire was moved from September 10, 2004, to September 24, 2004. To date 28 completed questionnaires have been returned and results are reported below. Three names were drawn to receive this book. They have been contacted. All participants will be sent a $25.00 training voucher.
1. Monthly Teleconferences
Have you participated in RSA Region V CRP-RCEP monthly teleconferences? ______ Yes ______ No
If you have, what was your experience?
Comments
Suggestions for topics and improvements:
Sixteen respondents indicated their participation in one or more teleconferences. Of the respondents who indicated “no”, one of the main reasons was the inability to successfully connect to them.
Experiences of teleconference participants were very positive with comments such as “…a good way to get training without travel..,” “…they have all been very interesting and informative…,” “….appreciate the access to the archived presentations…, “…low cost training and they cover a wide range of topics…”, “….convenient…please continue!”..”….very good, casual, enthusiasm contagious”, “…wonderful service to provide free of charge..”, “ ….groups of staff listen to teleconferences regularly… generally good information and presenters…thanks for having presenters use PPTs – helps in understanding..”
Suggestions for topics and improvements include 1.) innovative ways to fund employment services, 2.) go beyond introductory subject matter, 3.) dealing with difficult family members, 4.) self-advocacy , 4.) SSI/SSDI/RSDI, 5.) interview questions, 6.) TBI, 7.) job development in rural areas, 8.) transition and parent involvement, 9.) have presentations available to print prior to presentation, 10.) need more notice of teleconference, and 11.) resolve the issue of background noises.
Summary of Feedback
For individuals or groups of people, teleconference presentations facilitate easy and inexpensive access to community rehabilitation experts, issues, and topics, by allowing dial up via the telephone or audio streaming via the Web. This mode of delivering training is successful and appreciated by those who use it.
Recommendations and Actions
Based upon suggestions for topics and improvements, CRP-RCEP staff will identify and schedule pertinent teleconferences based upon the above suggested topics and address the shortfalls. Suggested topics will be scheduled and respondents will be notified of upcoming presentations, as well as Web-archived presentations on similar topics.
To remedy having print material prior to presentation, the teleconference coordinator will e-mail registered participants at least a day in advance to remind them of the posted PPTs on the Web.
Regarding earlier notice of teleconference events, the teleconference coordinator will continue to ensure at least one month’s notice, as well as listserv notification in a timely manner. When possible, multiple presentations with dates will be advertised.
To date the issue of background noises and muting of telephones has been resolved. Using Netspoke’s teleconferencing services and features, the teleconference coordinator is able to mute all phones if needed.
Staff will contact those indicating that they have not participated in teleconferences and encourage them to try them. For those whose past experiences were disappointing, staff will encourage them to try again. Over the course of three years, technical difficulties of audio streaming and dial up have been remedied with successful connections. Staff no longer receive complaints from registered participants about ability to participate.
Do you read the RSA Region V CRP-RCEP newsletter? ______ Yes ______ No
If you read this publication, what do you think?
Comments
Suggestions for topics and improvements:
Twenty-six of the 28 respondents read the newsletter. Comments include…”interesting and helpful,” …”very informative with lots of information on training,” “informative and well organized”, “some good information,” “I skim for information that pertains to me”, “good to reference for resources and upcoming events…enjoy reading new perspectives on VR and employer relations”, “would prefer more ‘meat’ content rather than inservice information that’s available on the net “ “very good information especially the training calendar and resource listing”, “excellent – short and to the point”, “..good info – I like the recap of sessions I am not able to attend”, “ I think the publication is well written and provides useful information.”
Suggestions for topics and improvement include more articles about other programs, practices, and struggles, more “meat” in content vs. in-service information, download to the Web site, provide information from all six states, rather than just Illinois.
Summary of Feedback
It’s apparent that most respondents read or skim the newsletter. Almost all respondents think it’s informative and useful for keeping up to date with topics and trainings.
Recommendations and Actions
To provide a broader coverage of the six-state RSA Region V, efforts should be made to solicit information at the local level as well as the state level. The next issue of the newsletter will be a better attempt to do this. P3 winners have been contacted to provide information about their practices and programs in each of their states. To date, two programs have indicated their desire to send information. A message to the RSA Region V CRP-RCEP listserv was sent requesting news from the different states, as well as community programs. Information from Web sites in all six states will be pro-actively searched to provide more content. To address the more “meat” issue, the editor will also contact respondents to get suggestions. Ongoing contact with state committee members and advisory board members will be instituted to gather additional information about topics and issues in each state, as well as at the national level.
These attempts will be ongoing so that Around the Region truly reflects what is going on around the region in all six states.
3. Listserv (contact leachlyn@uiuc.edu to subscribe to this free listserv)
Are you a subscriber to the RSA Region V CRP-RCEP Listserv? ______ Yes ______ No
If you are, what do you think?
Comments
Suggestions for improvements:
Seventeen of the 28 respondents are subscribers to the listserv. Comments include “great way to get information quickly”, “I rely on it for announcements that I may miss in other places..”, “yes, it’s nice to get reminders of upcoming events and training”, “e-mail is the easiest way to reach me so I love this”, “I really like getting information of upcoming conferences, etc. I always make copies and send them to my co-workers, “ “good resource materials – I have shared many articles and Web links with staff..”.
Two people had suggestions to improve the listserv that included more online courses and topics about people with specific disabilities and keeping messages pertinent to a particular state. These suggestions, relevant to trainings, teleconferences, and the newsletter, will be considered. One person who is no longer a subscriber said that because there were too many viruses, he was required to withdraw subscription.
Summary of Feedback
For those who are listserv subscribers, they appreciate the training and event updates as well as the ease in information dissemination.
Recommendations and Actions
Those who are not subscribers will be contacted and asked to join. Viruses were once a problem particularly with messages that had attachments. To date this problem doesn’t exist because the limitations of the listserv have been changed so that attachments are no longer an option for subscribers. RSA Region V CRP-RCEP staff should continue to market this listserv via trainings, newsletters, and teleconferences.
4. Web site – www.ed.uiuc.edu/illinoisrcep
Have you visited the RSA Region V CRP-RCEP Web site? ______ Yes ______ No
Do you use this Web site as a resource for community rehabilitation information? ______ Yes ______ No
If you have, what do you think?
Comments
Twenty of the respondents said they have visited the Web site - www.ed.uiuc.edu/illinoisrcep - with twelve people indicating they use it as a resource …“lots of good information” “I think I will use it for working with young adults and I think it can be helpful for me too..” “very informative..” “an excellent resource in keeping up to date on cutting edge rehabilitation practices, best practices, etc…”
Suggestions to improve include more topics on specific disabilities, parent involvement, job retention, and job development. One respondent thought the site wasn’t easy to navigate and recommended access by state.
Summary of Feedback
Most respondents have visited the Web site yet do not really use it as a resource. The comments and suggestions that were received were broad.
Recommendations and Actions
Even though the majority of respondents have visited the Web site, the effectiveness and utility of it as a resource could be improved, as well as the navigation. Even though there was no specific question regarding Web site design, one person thought it was hard to access information. It would be a good idea to re-think some features of the site to make information more accessible and navigation easier. The Web master will work to highlight the features of the topical bibliography and the state resources, as well as do collection development in the suggested topics. Perhaps in the future, a focus group of users could advise on improvement of site.
5. RSA Region V CRP-RCEP at Illinois
Please give us any other comments, ideas, suggestions, or requests for training and technical assistance.
One-half of the respondents gave us feedback that included “Keep up the good work”, “I’d love to know what agencies are doing in other parts of the country to keep open…”, “We have used your training in the past year and plan to continue using it. The quality of information and speakers has been very good…only disappointment was the August 18, 2004 session on employment services for ex-offenders…would like training on developing Web sites”, “As a program manager I appreciate trainings that assist me in being an effective, efficient manager..” “Best training ever was Supporting People on the Job with Sue Ann and Tom..” “Thank you for the hard work you do - I appreciate your Web site, listserv, trainings, publications etc. – they are very valuable to the work I do...” “….work on low-level consumers finding jobs in a rural, job-challenged area..” “I would like more online classes that would count toward actual college credits in the field of employing people with disabilities or in specific areas of disabilities..” “…would like more information regarding specific mental illnesses….ADHD… and the most suitable vocations..”, “I’ve always enjoyed the training and found them helpful..”, “Keep staying visible!”, “I have attended RSA trainings and think they are wonderful – thank you for the opportunities!”, “More web-based training needed at reasonable costs for those with limited funds and travel expenses – this survey would have been better handled online!” “I think the training seminars have been very good – cover a wide variety of topics…I think it is great that the teleconferences and online courses are offered…one thing to improve – rotate from state to state so everyone gets a chance to attend…”
Summary of Feedback
The feedback included comments that were very complimentary as well as suggestions to improve. Fourteen people had no general comments or suggestions for improvement – this perhaps suggests their overall satisfaction with the activities of the RSA Region V CRP-RCEP.
Recommendations and Actions
From these general comments and suggestions, it is apparent that for the most part the in-person trainings have been well received, should be continued, and offered in each state. Online, Web-based courses are in demand, however, and more should be developed and perhaps continuously offered.
Conclusion and Overall Recommendations
Even though the responses were limited to a small group of people, the feedback in these five areas was very positive with constructive suggestions for improvement. The RSA Region V CRP-RCEP activities are appreciated by most and should be continued and improved based upon comments. RSA Region V CRP-RCEP staff should consider the findings from this questionnaire and take appropriate action. Findings should also be shared with state committees as well as the advisory board to guide future trainings. Participants of this survey could be considered for future contact and relationship building across states. Soliciting feedback from the RSA Region V CRP-RCEP audience should be done routinely not only for customer satisfaction and program improvement, but also to keep the lines of communication and information sharing open among all stakeholders.