1 to 10 of 12
Sort by

Library Entry
Eval11 Session 920: Using Research Electronic Data Capture (REDCap) for Designing a Data Collection System in the Field

REDCap also makes it easy to import case-level data from a service agency's Management Information System (MIS) securely

2 attachments

Focus Search - • A non-commercial use data collection and management system created by Vanderbilt University with funds from NIH • Robust and secure repository of client-level data stored on HIPAA/FERPA-compliant servers for research projects or other applications • Able to integrate and store respondent-level data across existing databases and any data collected in the field by home visiting program staff. • Easily customizable and able to be configured in multiple ways to suit the needs of a given project The Consortium • • 288 active institutional partners from around the globe • Typically, a centralized group at each institution houses REDCap to prevent infrastructure duplication • Serves nearly 23,000 research projects and just under 33,000 end users • Project production has grown exponentially in the past five years How Has Been Used • Prospective Research and Evaluation Studies • Data Collection for Chart Reviews • Multi-Site Data Collection (domestic and international) • Basic Research Studies • Behavioral Research Studies (Survey) • CTSA-wide research studies • (Statin Treatment for Influenza Patients Trial) • CTSA-wide research on research studies (Committee #1 IRB + Contracts) • Quality Improvement • Research Operations Support (tracking databases) • Education Support – Teaching Tool • Project Management • Lab Specimen Tracking • Survey can be used as a surrogate web application • State performance management systems for home visitation Key Considerations for Selecting Key Considerations for Selecting • COST: Need a cost-efficient way to collect and manage research and evaluation data • CAPACITY/STAFFING: Need a system that evaluation staff can use with limited knowledge of data sytems • NEW DATA: Need ability to collect new screening or clinical instruments for outcome measuring • EXISTING DATA: Needed a way to interface with existing information management systems (if they exist) • REPORT GENERATION: Need to export data or run ad-hoc reports that are easily configurable for multiple purposes • DATA SECURITY/CONFIDENTIALITY: Need the data to be secure when collecting, storing or importing; need a HIPAA Compliant server to transfer Protected Health Information (PHI) Key Considerations for Selecting • FIELD USE: Need the ability to collect and transfer screening or program data directly into MIECHV database during a home visit if desired • FUNCTIONALITY: Need to de-identify data as needed, restrict user access to some data, create schedules, be used as a case management system (if needed), track program data • VERSITILITY: Need it to be easy to customize, configure, or change as new program data or screening instruments are introduced Key Considerations for Selecting • TECHNOLOGY: Need to be able to securely interface with technology used by research assessors in their office, in the participants’ homes, or on the road if needed to reduce data entry labor costs Key Considerations When Selecting Internet access through Wi-Fi and 3G capabilities for in the field use Interactive use during face to face interviews Example of a Data System for an Evaluation Project • Adolescent Family Life Generations Project • Rigorous research and evaluation study testing the effectiveness of enhancing a home visiting program for pregnant teens with an educational support group for their parents, mental health services, and social media outreach • Kansas’ Maternal Infant Early Childhood Home Visiting (MIECHV) Program • Creating a Performance Management System to enable state to respond to federal reporting requirements and integrate evaluation and CQI • Working with four home visiting program models in each of three counties • Matching and integrating data from multiple agencies with different management information systems with the state’s child welfare data • Nebraska’s MIECHV Program • Working with one home visiting program across three counties in one agency • Matching and integrating data from one agency’s management information system with the state’s child welfare data How We Use • Generations Project Overview • Testing the effectiveness of enhancing a home visiting program for pregnant teens with an educational support group for their parents, mental health services, and social media outreach. • Kansas Children’s Service League -Healthy Families program in Wyandotte and Shawnee Co, KS • KU Institute for Educational Research and Public Service & School of Social Welfare How We Use Office of Adolescent Pregnancy Programs Generations Project Overview Services for Family In-home mental health assessment & services as needed Services for Teen KCSL Healthy Families Home Visiting Referral to Community Mental Health TREATMENT GROUP CONTROL GROUP KCSL Healthy Families Home Visiting Services for Grandparent Grandparent Education & Support Group Social Media & Support Networking Generations Project Overview Immunizations for Babies Reduced Repeat Teen Pregnancies Educational Attainment for Teens Social Support, Mental & Physical Health, Family Functioning Generations Project Data Map KCSL’s Mental Health Database Teen Parent Both Field Interviews with Teens and Parents of Teen What is the construct or outcome we want to measure?

Library Entry
Collaboration and Data Collection: A Discussion of Available Technologies that Foster Inclusiveness and Participation in Child welfare Evaluation

Roundtable session notes and handouts. #Tool #technology #Survey #program #software #Collaboration #datacollection #questionnaire

2 attachments

Focus Search - · Integrated reporting tool · Flexible search parameters · Drill-down results search · Works for English, French, Spanish, & German Voxco (panel management system) · Chooses participants based on optimal attributes for survey · Shows survey questions based on participant attributes · Manage email invitations and participant database · Create personalized panelist portal Survey Monkey (phone surveys) · Design/send automated phone surveys · Upload respondent phone list or provide phone number for respondents to call · Respondents reply using phone keypads · Supports voice capture & can use your voice or someone else’s for recording · Results in real time · Survey templates available CyberTracker · Enables geo-referenced data collection through hand-held devise using GPS · Data downloaded to database using CyberTracker application on PC · Data can be viewed in tables, maps, graphs, & Excel · Can attach photos to specific data points · Initially developed for environmental conservation field but adapted to additional fields · Developed specifically for use by illiterate populations · Can be used with special hardware or Smartphone Dragon Naturally Speaking · Speech recognition software that turns spoken words into text · Can be used to streamline qualitative data collection · Can be used with portable digital recorder or smartphone · You can add vocabulary related to your field · Also executes voice commands on your PC · Options to manage large user networks Morae · Record/remotely observe PC users’ mouse clicks, page changes, facial expressions, & eye movement · Collaborate with your research team during observations · Tag notes and highlight moments as they occur in real time + All in one observations and notes · Plug-ins can be developed to suit particular research needs Group Quality · Conduct online discussion boards, live focus groups, & surveys · Works for live chat groups, webcam groups, & website usability groups · Shared image markup tool · Manage panels Vroom · Virtual qualitative and collaboration suite · Allows live interaction between moderators and participants through webcams (with recording for later analysis) · Group can review stimuli (images, video, PowerPoint, hyperlinks, etc.) during discussion · Participants can collaborate through use of white board feature · Virtual room can be split into subgroups at any time Happiness Survey · Ongoing, easy-to-use online survey (through web browser on PC or mobile) · User sets up daily email/text reminders to complete survey · Meant for collecting data multiple times throughout the day Collaboration Technologies Central Desktop · Cloud sharing of files, calendars, conversations, project plans, etc. · Automatically assign tasks, update databases, send email reminders, and documents · Works on mobile · Private, secure, centralized sharing and collaboration Adobe Connect · Web conferencing platform, with recording options · Uses webcams for face-to-face calls · Grid mode to view all users at once · Can share screen & multimedia resources · Create customized virtual meeting rooms for repeated use · Store files, documents, layout and notes for later use · Also serves as webinar platform and for e-learning · Works on various devices including mobile Smartsheet · Easy to use spreadsheet that generates calendars, Gantt charts, and reports · Online accessibility, message threads, and email reminders for collaboration · Able to attach files or internet links to a row · Works on tablets and mobile Basecamp · Online project management software · Invite collaborators · Collaborate and assign tasks · Send and store messages · Store and share files · Create and share calendars and Gantt charts Gliffy · Create diagrams such as flowcharts, organizational charts, UML diagrams, network diagrams, wireframes, technical drawings and others · Can share and collaborate with anyone to internet access · Export as JPG, PNG, SVF or a GLIFFY · Can share read-only version via URL or social media · Can go back and edit existing diagrams Lucidchart · Same as Gliffy, and… · Includes group chat and comments · Accessible on mobile apps (Android & iOS) Creatly · Same as Gliffy/Lucidchart, and… · Full revision history of all changes GoTo Meeting · HD video conferencing with audio included through PC or phone with recording options · Manages invitations, registrations, reminders, polls/surveys · Can share your screen and keyboard/mouse control · Multiple interactive tools: drawing tools, “raise hands” for speaking, chat · Monitor Q&A · Monitor attendee participation and produce reports · Upgrade available for large webinars or trainings Technology Tools Suggested by Roundtable Participants Name URL Data Collection Technologies Confirmit MTurk Social Solutions—Efforts to Outcomes Open Data Kit Salesforce Classic Magpi CommCare Collaboration Technologies Google Drive (AKA Google Docs) Anymeeting Trello Asana Evernote [bookmark: _GoBack] American Evaluation Association: Evaluation 2014 Conference | October 16, 2014 Salvador Armendariz (, Anna de Guzman ( and Data Collection: A Discussion of Available Technologies that Foster Inclusiveness and Participation in Child welfare Evaluation Visionary Evaluation for a Sustainable, Equitable Future AEA Roundtable Session October 16, 2014 Presented by: Salvador Armendariz and Anna deGuzman Butler Institute for Families, University of Denver Collaboration & Data Collection Technology October 2014 Butler Institute for Families Purpose To get us thinking about ways in which we can harness the power of technology in the evaluation process to create a more inclusive collaborative environment among evaluation and/or project partners as well as those individuals and communities from whom we obtain information through data collection. Collaboration & Data Collection Technology October 2014 Butler Institute for Families 2 Summary of Collaboration Tools Presented Online project management software that allows for real-time collaboration and contains organizational tools such as calendars, Gantt charts, message threads, file storage, and automatic task reminders

Library Entry
Eval12 Session 277: Growing a Backbone: Place-based Work and Collective Impact

Abstract: Recent work by the Foundation Strategies Group on “collective impact” has been getting a great deal of attention in philanthropic, government and nonprofit arenas. This panel will present three different evaluations of projects in Grand Rapids, Michigan that are applying the collective...

Growing a Backbone Place based Work and Collective Impact.pptx

Library Entry
Session 161 AEA 2013 - Harnessing Big Data in Higher Education - Evaluators as Data Scientists

This handout summarizes the key points presented in this session along with references and links to documentation. #highereducation #bigdata


Library Entry
Pencil Versus Keyboard: An Assessment of Alternative Methods for Evaluating Social Services Outcomes

For a number of years, the United Way of Greater Houston (UWGH) has facilitated affinity groups of agencies in the same services field to evaluate common outcomes. Among these affinity groups have been those providing services to victims of domestic and sexual violence (six agencies with about...

Pencil Versus Keyboard_CMedits.pptx

Library Entry
Handling Data: From Logic Model to Final Report Handout from SI10

Sessions Description: Collect, analyze, and present data from complex evaluation studies in ways that are feasible for the evaluator and meaningful to the client. Explore lessons learned through over twenty years in evaluation consulting to ask the right questions, collect the right data and...