That looks like an interesting exercise. Problems might be: It is one dimensional; it depends on what the participants write and edit (though you could start with a few that highlight all relevant aspects, as an example and prompt, because when a new one is compared with it, people would notice the new one was not specific). What we see in the demo is a simple prioritization. A one-dimensional rank order. Many other methodologies are a) multidimensional: they specify “benefits, harms, and costs” for example, and one can go research each of those separately (after the community has identified what they care about), get evidence based measures, develop principled tradeoffs between dimensions; and actually calculate a “value of information” if the words in the grant proposal need to be taken seriously. I could envision the interaction between community and researchers to involve flow in both directions, say flow of what is possible, and of how to measure, from researchers to community, and flow of what we suffer, what aspects we’d like improved, how bad the various aspects of our situation are, how much a specified improvement in one problem is desired, compared to a specified improvement on a different problem. That kind of info is what is useful to forward to the resource allocators, so they can think about which programs to fund. I don’t know that the position of a 3 sentence description on a rank ordered priority list would provide useful information to a resource allocator, in terms of the good actually produced; other than “promise to spend money on what they tell me they want, and I’ll be popular with the community”. Rob From: PDQNet Core Research Team [mailto:[log in to unmask]] On Behalf Of Norton, Barbara L. (HSC) Sent: Tuesday, March 01, 2016 1:31 PM To: [log in to unmask] Subject: FW: Prioritizing initiatives for improving the protection of human subjects and patient/other stakeholder contributors in patient centered outcomes research (PCOR) Ken (and other PDQNet CRT members) – Take a look at this and ask your CS Mapping gurus also to give their take on it, and how CS Mapping differs: https://urldefense.proofpoint.com/v2/url?u=http-3A__www.codigital.com_-23_&d=BQIGaQ&c=qRnFByZajCb3ogDwk-HidsbrxD-31vTsTBEIa6TCCEk&r=gs6Pty48wctqW5dY1LjmZEv1_xHZo2iTYbVhDFjF9FE&m=zrCepUkzZ3mXJXIKWNRZynQFn67DRbTeEthK6z_tZ9g&s=sy62i3pfthM9NTJtH-RGL5H4l7ik3yNgI2RtQ5DYRoE&e= <https://urldefense.proofpoint.com/v2/url?u=http-3A__www.codigital.com_-23_&d=BQMGaQ&c=qRnFByZajCb3ogDwk-HidsbrxD-31vTsTBEIa6TCCEk&r=gs6Pty48wctqW5dY1LjmZEv1_xHZo2iTYbVhDFjF9FE&m=NhyUprtv6TCxDUNZW0NWShKicZovJSzvZN8eCtqHGqY&s=FCjMmsEjCpr9pzr1qmUVLPT59idk4Xv_UQkuCTJLmv0&e=> and watch the intro video. I really like their graphics! I might suggest CS Mapping take a page out of the Codigital presentation playbook. It seems to me that CS Mapping is just too hard to understand for most folks – at least the way I’ve seen it presented. Then click on the blue bar in the email string below. You’ll see that it takes you to a site that poses a question, asking you to brainstorm ideas. Like our project, the question is very conceptual, and I found myself immediately dumbfounded, unable to generate a single idea (esp. because the question does not remain on the screen). I really wonder if we won’t have to “prime the pump” with those participants doing this the CS Mapping brainstorming activity on-line? I also wanted to know if the CS Mapping screens continually show the focus prompt, so that people can keep it in their minds as they try to generate ideas. Barbara From: [log in to unmask]<mailto:[log in to unmask]> via Codigital [mailto:[log in to unmask]] Sent: Tuesday, March 01, 2016 8:40 AM To: Norton, Barbara L. (HSC) Subject: Prioritizing initiatives for improving the protection of human subjects and patient/other stakeholder contributors in patient centered outcomes research (PCOR) Please help us prioritize a list of initiatives for improving the protection of human subjects and patient/other stakeholder contributors in patient centered outcomes research (PCOR). Compared to traditional research, PCOR often involves patients, caregivers, and other non-researcher stakeholders (i.e. community members) in unique ways. In PCOR, patients and other stakeholders often act as human subjects or research participants. They may also serve as advisors to study teams, members of study teams, or investigators. In PCOR, patients and other stakeholders may: (1) Help researchers identify important research questions; (2) Design and implement studies; and (3) Interpret and disseminate study results. The increased engagement of patients and other stakeholders in research has led to new challenges related to the protection of human subjects in research. By prioritizing and adding to the list of initiatives, you will be taking the first step in creating new guidance and policies that will help reduce risks for PCOR participants and contributors. The "ENTER SITE" button below will bring you to a page that allows you to explore the diferent functions of codigital and participate in the activity. Most importantly, we ask that you use the "RANK" button to prioritize the initiatives that you think are most important. If you would like additional instructions on how to use the codigital website, and its various functions, the "intro video" on the following webpage gives a concise and helpful introduction: https://urldefense.proofpoint.com/v2/url?u=http-3A__www.codigital.com&d=BQIGaQ&c=qRnFByZajCb3ogDwk-HidsbrxD-31vTsTBEIa6TCCEk&r=gs6Pty48wctqW5dY1LjmZEv1_xHZo2iTYbVhDFjF9FE&m=zrCepUkzZ3mXJXIKWNRZynQFn67DRbTeEthK6z_tZ9g&s=iXyDGa4twNRM6T1CE5padshKBGqszAHd94AisVox7yg&e= <https://urldefense.proofpoint.com/v2/url?u=http-3A__www.codigital.com&d=BQMGaQ&c=qRnFByZajCb3ogDwk-HidsbrxD-31vTsTBEIa6TCCEk&r=gs6Pty48wctqW5dY1LjmZEv1_xHZo2iTYbVhDFjF9FE&m=NhyUprtv6TCxDUNZW0NWShKicZovJSzvZN8eCtqHGqY&s=FiKYq2t37NvoqSDJReW1Vtn_Lq17uM4c3D9bsNXCtYs&e=> If you have additional questions, email our project manager (Anna de la Motte) at [log in to unmask]<mailto:[log in to unmask]>. Thank you for your interest in this work! Enter Site >> <https://urldefense.proofpoint.com/v2/url?u=http-3A__email.codigital.com_wf_click-3Fupn-3DfwLef6RriBANSS6i3iNOynZ8D95hde7IogKlBSDN7HNRFW6JPmW8aNL1inRqwXN1YZiACKgbficcn0-2D2FHQRUrUyJ1c30RQFZivjwXUZMAn-2D2BSAwRn0RX-2D2FysZ46L01a7aKltZ-2D2FVgZzJqNFzIkND-2D2B2lORNTKrCj-2D2BH6f2Wf5kUKnDQ4o-2D3D-5F6oHheLcG-2D2BckXtTXMtnNR9jzluPqjB1dXgDnxEByiWrqIhmVKCBUm9V4WH1hZffpn4dKesvWpaMCHceJXWYYYl9rI-2D2B0ErSciu13JnDi3TwUC4f8Fn62kk5vLZk25708FQ9MnyskdIvZNXBdPelENmKzWctNImODY8XT7bXlE90kjoTXvtrB7wr58fG-2D2B9kMtsRPJVYIfDTHNt9CTQG8DwGBy0VR6kpwfCbkD2n1MF4bvasXl2-2D2FFsHTOml4KfaAmAJF0gJNwmnxB2eiPbbbg9xrruCjXA7ayWHoqVxXUC4WkpyXhLEAm2kOYyPC-2D2B-2D2Fzn7h3Nbnv5o-2D2F8673oFgUy-2D2FVAQmu2-2D2FgTsUBDeJRaK1-2D2B61lZJzY-2D3D&d=BQMFaQ&c=qRnFByZajCb3ogDwk-HidsbrxD-31vTsTBEIa6TCCEk&r=WqV8dDZkd5mHUjxs7dOItPq3biYE0LZn2DSurJT5lY4&m=-8YEPA1KRBEKxPXMI78ahxw-YM6bP0eXlcjWsouoiio&s=Xvd37dwnmCwzqsAbQsHof_GqJ_-bP7M3K8WWj4gglDo&e=> To change your email settings, click here<https://urldefense.proofpoint.com/v2/url?u=http-3A__email.codigital.com_wf_click-3Fupn-3DfwLef6RriBANSS6i3iNOynZ8D95hde7IogKlBSDN7HNRFW6JPmW8aNL1inRqwXN1YZiACKgbficcn0-2D2FHQRUrUyJ1c30RQFZivjwXUZMAn-2D2BQZ6paN87sobQRlWrkyDwUeP8rNXVWSm6Kqfmpxpf6bJPIDOTPqVoqXvpw5iREqEog-2D3D-5F6oHheLcG-2D2BckXtTXMtnNR9jzluPqjB1dXgDnxEByiWrqIhmVKCBUm9V4WH1hZffpn4dKesvWpaMCHceJXWYYYl9rI-2D2B0ErSciu13JnDi3TwUC4f8Fn62kk5vLZk25708FQ46tEn-2D2BCm5Xku-2D2BVIrQ41RY2iUXgbm7rpktL8ZCqaOC-2D2FyxhoJDTc4RpkW47CTAIbvP3xvZddOpq5TTCFmzpdndMjd91mTfLAZMWVQ7iDGWs3gld4Efc8kJOSE6upTQjSWgKdXlqLsCxq-2D2Boy7aCc9EvUQPfFHAXQw9b4wJO3tCz3oHeLXgd7aygExBmdfySEMmTg9zAkfZ8d8lzWgox9Q6dytdK-2D2F37e9pjbsdlnmKgdxfQ-2D3D&d=BQMFaQ&c=qRnFByZajCb3ogDwk-HidsbrxD-31vTsTBEIa6TCCEk&r=WqV8dDZkd5mHUjxs7dOItPq3biYE0LZn2DSurJT5lY4&m=-8YEPA1KRBEKxPXMI78ahxw-YM6bP0eXlcjWsouoiio&s=f-pRORLAYFEoMdEbzquz3PEKwQK5ZPj5wd1G9kYXXYc&e=>. By clicking the link above you agree to Codigital's Terms of Use<https://urldefense.proofpoint.com/v2/url?u=http-3A__email.codigital.com_wf_click-3Fupn-3DfwLef6RriBANSS6i3iNOynZ8D95hde7IogKlBSDN7HNRFW6JPmW8aNL1inRqwXN1YZiACKgbficcn0-2D2FHQRUrUyJ1c30RQFZivjwXUZMAn-2D2BRatDPO-2D2BVJQX-2D2BYH-2D2Fux8HZPM8gAVEOT6OjfOGXmQxAyD5Bt0qi6Miv-2D2BGx7MsyPorwlE-2D3D-5F6oHheLcG-2D2BckXtTXMtnNR9jzluPqjB1dXgDnxEByiWrqIhmVKCBUm9V4WH1hZffpn4dKesvWpaMCHceJXWYYYl9rI-2D2B0ErSciu13JnDi3TwUC4f8Fn62kk5vLZk25708FQ41f2A1LMcPlbup9gYE8-2D2FCmxnepSJUP2IXsw-2D2B2z0YQm6HD030BD7TXLDQeiV-2D2BXqRLQcvy0m9vhWkqafRk-2D2FKAydQxCfW0clh-2D2Bhx1HorhdwYqZijGU0HarM9U769W4cG6zxgLcAA2OtLRyfQveQjdcW4RUlQMmyhuEP2DzYAY1LckDhh74y5QbPGhelo1DJsDU2e45WILRXTEGhqY5jNxtQPI3u6Fd-2D2FT8DwRkA5QZWRJxQ-2D3D&d=BQMFaQ&c=qRnFByZajCb3ogDwk-HidsbrxD-31vTsTBEIa6TCCEk&r=WqV8dDZkd5mHUjxs7dOItPq3biYE0LZn2DSurJT5lY4&m=-8YEPA1KRBEKxPXMI78ahxw-YM6bP0eXlcjWsouoiio&s=Ss6iGQwpOv8uvAH6XcjSn3_lrPOgor76FpvOfLqYRBQ&e=> and Privacy Policy<https://urldefense.proofpoint.com/v2/url?u=http-3A__email.codigital.com_wf_click-3Fupn-3DfwLef6RriBANSS6i3iNOynZ8D95hde7IogKlBSDN7HNRFW6JPmW8aNL1inRqwXN1YZiACKgbficcn0-2D2FHQRUrUyJ1c30RQFZivjwXUZMAn-2D2BSFR5ulVj7eNbonKsJw4OEApto70qKWk79ZQeR04NMH1YJm8I5Js-2D2FXlJ3Xrqpaznxk-2D3D-5F6oHheLcG-2D2BckXtTXMtnNR9jzluPqjB1dXgDnxEByiWrqIhmVKCBUm9V4WH1hZffpn4dKesvWpaMCHceJXWYYYl9rI-2D2B0ErSciu13JnDi3TwUC4f8Fn62kk5vLZk25708FQE10T6FPeJZRNbrJL7K-2D2BaLi8LSE-2D2FRjFBdpob-2D2FExUR2xzmyRRCWuU9SCAhjbI1AeIqy8Nw1g5csfZh6JhBpyHaCjjHLvIblneJ-2D2BrAEwn6yP2W-2D2FtaFi12uSzBthXvXYr-2D2Bgi-2D2BWn0dojjA8dO2fBjpxBB8FI5xR9IsEQ64HDM-2D2BucB6GgFK3XILlnb2ZTuAFqR5cejaYCd5BGuqQAtFPEcYPSyUonmWNA4d-2D2FYtA4p64QGK4hQ-2D3D&d=BQMFaQ&c=qRnFByZajCb3ogDwk-HidsbrxD-31vTsTBEIa6TCCEk&r=WqV8dDZkd5mHUjxs7dOItPq3biYE0LZn2DSurJT5lY4&m=-8YEPA1KRBEKxPXMI78ahxw-YM6bP0eXlcjWsouoiio&s=LzP8bMCWwwzuu_P_H3krlhcJ2oU2RCvnOl10EeXdmU8&e=>. [https://urldefense.proofpoint.com/v2/url?u=http-3A__app.codigital.com_track_notification_c1c97541bdfd57bb7352d39a64c44988&d=BQIGaQ&c=qRnFByZajCb3ogDwk-HidsbrxD-31vTsTBEIa6TCCEk&r=gs6Pty48wctqW5dY1LjmZEv1_xHZo2iTYbVhDFjF9FE&m=zrCepUkzZ3mXJXIKWNRZynQFn67DRbTeEthK6z_tZ9g&s=QIvKFUv6-gM_EOZwrGgZ1CBFEQ37mdqjKCO2QeIRu6o&e= ]