{"id":1574,"date":"2020-07-23T13:38:32","date_gmt":"2020-07-23T12:38:32","guid":{"rendered":"https:\/\/mmuperu.co.uk\/bjcj\/?p=1574"},"modified":"2022-12-19T12:57:32","modified_gmt":"2022-12-19T12:57:32","slug":"time-to-reset-the-clock-on-the-design-of-impact-evaluations-in-criminology-the-case-for-multi-methodology-designs","status":"publish","type":"post","link":"https:\/\/mmuperu.co.uk\/bjcj\/articles\/time-to-reset-the-clock-on-the-design-of-impact-evaluations-in-criminology-the-case-for-multi-methodology-designs\/","title":{"rendered":"Time to Reset the Clock on the Design of Impact Evaluations in Criminology: The Case for Multi-Methodology Designs"},"content":{"rendered":"

[vc_row row_height_percent=”0″ override_padding=”yes” h_padding=”2″ top_padding=”3″ bottom_padding=”2″ overlay_alpha=”50″ gutter_size=”3″ column_width_use_pixel=”yes” shift_y=”0″ z_index=”0″ column_width_pixel=”1000″ shape_dividers=””][vc_column column_width_percent=”100″ position_horizontal=”left” gutter_size=”2″ override_padding=”yes” column_padding=”0″ overlay_alpha=”50″ shift_x=”0″ shift_y=”0″ shift_y_down=”0″ z_index=”0″ medium_width=”0″ align_mobile=”align_left_mobile” mobile_width=”0″ width=”2\/3″][vc_custom_heading text_font=”font-128611″ text_size=”h3″ text_weight=”500″ text_color=”color-210407″]Articles[\/vc_custom_heading][vc_separator sep_color=”color-210407″ el_height=”1px”][vc_custom_heading auto_text=”yes” text_font=”font-128611″ text_size=”h1″ text_weight=”500″ text_color=”accent”]This is a custom heading element.[\/vc_custom_heading][vc_column_text]<\/p>\n\n\n\n\n\n\n\n\n
Published<\/span><\/td>\n23\/07\/2020<\/td>\n<\/tr>\n
Type<\/td>\nArticle<\/td>\n<\/tr>\n
Author(s)<\/td>\nStephen Morris, Andrew Smith, Chris Fox<\/td>\n<\/tr>\n
Corresponding Authors<\/td>\n<\/td>\n<\/tr>\n
DOA<\/td>\n<\/td>\n<\/tr>\n
DOI<\/td>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n

[\/vc_column_text][vc_column_text]<\/p>\n

This paper highlights how qualitative research can enhance causal explanation in impact evaluations and provide additional causal leverage to findings from randomised experiments. We assess the extent to which randomised studies in criminology adopt mixed or multi-methodological approaches as seen in other fields such as health care, education and international development. We reviewed current practice in the design of experimental evaluations within criminology. Structured searched terms previously used to identify qualitative research components within randomised studies in health research, were used to search for evidence of mixed method design in 46 primary studies involving randomisation, published in four leading journals in criminology since 2013. Although such mixed-method randomised studies are increasingly seen in other fields such as health, education and international development, among the studies we identified in criminology and criminal justice our review reveals almost an entire absence of designs in which qualitative research is formally and explicitly integrated into study designs. We argue that randomised studies are significantly enhanced through incorporating explicit and planned mixed-method elements, and particularly qualitative research. We suggest reasons for this absence and what might be done to address it.[\/vc_column_text][vc_row_inner][vc_column_inner column_width_percent=”100″ gutter_size=”3″ overlay_alpha=”50″ shift_x=”0″ shift_y=”0″ shift_y_down=”0″ z_index=”0″ medium_width=”0″ align_mobile=”align_center_mobile” mobile_width=”0″ width=”1\/1″][vc_button button_color=”accent” size=”btn-lg” radius=”btn-square” wide=”yes” border_width=”0″ link=”url:http%3A%2F%2Fmmuperu.co.uk%2Fbjcj%2Fwp-content%2Fuploads%2Fsites%2F441%2F2020%2F09%2FBJCJ_Morris_Smith_Fox_2020.pdf||target:%20_blank|”]Download PDF[\/vc_button][uncode_share layout=”multiple” bigger=”yes” separator=”yes”][\/vc_column_inner][\/vc_row_inner][\/vc_column][vc_column column_width_percent=”100″ gutter_size=”2″ override_padding=”yes” column_padding=”2″ back_color=”color-lxmt” overlay_alpha=”50″ shift_x=”0″ shift_y=”0″ shift_y_down=”0″ z_index=”0″ medium_width=”0″ mobile_width=”0″ sticky=”yes” width=”1\/3″ css=”.vc_custom_1601208198355{padding-right: 26px !important;padding-left: 26px !important;}”][vc_custom_heading heading_semantic=”h3″ text_font=”font-128611″ text_size=”h4″ text_weight=”500″ text_color=”color-210407″]Latest Issue[\/vc_custom_heading][uncode_index el_id=”index-163686″ loop=”size:1|order_by:date|post_type:post|categories:2″ gutter_size=”3″ post_items=”title,date” screen_lg=”1000″ screen_md=”600″ screen_sm=”480″ single_text=”overlay” single_style=”dark” single_overlay_opacity=”50″ single_overlay_anim=”no” single_text_visible=”yes” single_text_anim=”no” single_h_align_mobile=”left” single_padding=”0″ single_title_family=”font-128611″ single_title_dimension=”h5″ single_title_weight=”400″][vc_button button_color=”accent” size=”btn-xl” radius=”btn-square” wide=”yes” custom_typo=”yes” font_family=”font-128611″ font_weight=”500″ border_width=”0″ link=”url:http%3A%2F%2Fmmuperu.co.uk%2Fbjcj%2Fnewsletter%2F|title:Newsletter||”]Subscribe to our Newsletter[\/vc_button][vc_raw_html]JTNDYSUyMGNsYXNzJTNEJTIydHdpdHRlci10aW1lbGluZSUyMiUyMGRhdGEtd2lkdGglM0QlMjI0MDAlMjIlMjBkYXRhLWhlaWdodCUzRCUyMjU0NSUyMiUyMGhyZWYlM0QlMjJodHRwcyUzQSUyRiUyRnR3aXR0ZXIuY29tJTJGYmpjb21tdW5pdHlqdXN0JTNGcmVmX3NyYyUzRHR3c3JjJTI1NUV0ZnclMjIlM0VUd2VldHMlMjBieSUyMGJqY29tbXVuaXR5anVzdCUzQyUyRmElM0UlMjAlM0NzY3JpcHQlMjBhc3luYyUyMHNyYyUzRCUyMmh0dHBzJTNBJTJGJTJGcGxhdGZvcm0udHdpdHRlci5jb20lMkZ3aWRnZXRzLmpzJTIyJTIwY2hhcnNldCUzRCUyMnV0Zi04JTIyJTNFJTNDJTJGc2NyaXB0JTNF[\/vc_raw_html][\/vc_column][\/vc_row]<\/p>\n<\/div>","protected":false},"excerpt":{"rendered":"

This paper highlights how qualitative research can enhance causal explanation in impact evaluations and provide additional causal leverage to findings from randomised experiments.<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"footnotes":""},"categories":[2],"tags":[],"class_list":["post-1574","post","type-post","status-publish","format-standard","hentry","category-articles"],"acf":[],"yoast_head":"\nTime to Reset the Clock on the Design of Impact Evaluations in Criminology: The Case for Multi-Methodology Designs - BJCJ<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/mmuperu.co.uk\/bjcj\/articles\/time-to-reset-the-clock-on-the-design-of-impact-evaluations-in-criminology-the-case-for-multi-methodology-designs\/\" \/>\n<meta property=\"og:locale\" content=\"en_GB\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Time to Reset the Clock on the Design of Impact Evaluations in Criminology: The Case for Multi-Methodology Designs - BJCJ\" \/>\n<meta property=\"og:description\" content=\"This paper highlights how qualitative research can enhance causal explanation in impact evaluations and provide additional causal leverage to findings from randomised experiments.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/mmuperu.co.uk\/bjcj\/articles\/time-to-reset-the-clock-on-the-design-of-impact-evaluations-in-criminology-the-case-for-multi-methodology-designs\/\" \/>\n<meta property=\"og:site_name\" content=\"BJCJ\" \/>\n<meta property=\"article:published_time\" content=\"2020-07-23T12:38:32+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2022-12-19T12:57:32+00:00\" \/>\n<meta name=\"author\" content=\"Nathan Monk\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Nathan Monk\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/mmuperu.co.uk\\\/bjcj\\\/articles\\\/time-to-reset-the-clock-on-the-design-of-impact-evaluations-in-criminology-the-case-for-multi-methodology-designs\\\/#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mmuperu.co.uk\\\/bjcj\\\/articles\\\/time-to-reset-the-clock-on-the-design-of-impact-evaluations-in-criminology-the-case-for-multi-methodology-designs\\\/\"},\"author\":{\"name\":\"Nathan Monk\",\"@id\":\"https:\\\/\\\/mmuperu.co.uk\\\/bjcj\\\/#\\\/schema\\\/person\\\/280e1d3e78088d24e4a8f17aab814061\"},\"headline\":\"Time to Reset the Clock on the Design of Impact Evaluations in Criminology: The Case for Multi-Methodology Designs\",\"datePublished\":\"2020-07-23T12:38:32+00:00\",\"dateModified\":\"2022-12-19T12:57:32+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/mmuperu.co.uk\\\/bjcj\\\/articles\\\/time-to-reset-the-clock-on-the-design-of-impact-evaluations-in-criminology-the-case-for-multi-methodology-designs\\\/\"},\"wordCount\":652,\"commentCount\":0,\"articleSection\":[\"Articles\"],\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/mmuperu.co.uk\\\/bjcj\\\/articles\\\/time-to-reset-the-clock-on-the-design-of-impact-evaluations-in-criminology-the-case-for-multi-methodology-designs\\\/#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/mmuperu.co.uk\\\/bjcj\\\/articles\\\/time-to-reset-the-clock-on-the-design-of-impact-evaluations-in-criminology-the-case-for-multi-methodology-designs\\\/\",\"url\":\"https:\\\/\\\/mmuperu.co.uk\\\/bjcj\\\/articles\\\/time-to-reset-the-clock-on-the-design-of-impact-evaluations-in-criminology-the-case-for-multi-methodology-designs\\\/\",\"name\":\"Time to Reset the Clock on the Design of Impact Evaluations in Criminology: The Case for Multi-Methodology Designs - BJCJ\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/mmuperu.co.uk\\\/bjcj\\\/#website\"},\"datePublished\":\"2020-07-23T12:38:32+00:00\",\"dateModified\":\"2022-12-19T12:57:32+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/mmuperu.co.uk\\\/bjcj\\\/#\\\/schema\\\/person\\\/280e1d3e78088d24e4a8f17aab814061\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/mmuperu.co.uk\\\/bjcj\\\/articles\\\/time-to-reset-the-clock-on-the-design-of-impact-evaluations-in-criminology-the-case-for-multi-methodology-designs\\\/\"]}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/mmuperu.co.uk\\\/bjcj\\\/#website\",\"url\":\"https:\\\/\\\/mmuperu.co.uk\\\/bjcj\\\/\",\"name\":\"BJCJ\",\"description\":\"British Journal of Community Justice\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/mmuperu.co.uk\\\/bjcj\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/mmuperu.co.uk\\\/bjcj\\\/#\\\/schema\\\/person\\\/280e1d3e78088d24e4a8f17aab814061\",\"name\":\"Nathan Monk\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/5fc3733cd1573566f62865ea625e7e6ca5e2e6a28ed6e8ad889e373e7c4cae6d?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/5fc3733cd1573566f62865ea625e7e6ca5e2e6a28ed6e8ad889e373e7c4cae6d?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/5fc3733cd1573566f62865ea625e7e6ca5e2e6a28ed6e8ad889e373e7c4cae6d?s=96&d=mm&r=g\",\"caption\":\"Nathan Monk\"},\"description\":\"I'm proud to work for some of the world\u2019s most influential brands that shape cities and define lives: Universities and colleges. I provide advice to forward-thinking senior leaders on how to exceed their organisational targets by creating user-focused, digital-first strategies.\",\"sameAs\":[\"https:\\\/\\\/sleek.bio\\\/n\",\"https:\\\/\\\/www.linkedin.com\\\/in\\\/nathansmonk\\\/\"],\"url\":\"https:\\\/\\\/mmuperu.co.uk\\\/bjcj\\\/author\\\/nathansmonk\\\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Time to Reset the Clock on the Design of Impact Evaluations in Criminology: The Case for Multi-Methodology Designs - BJCJ","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/mmuperu.co.uk\/bjcj\/articles\/time-to-reset-the-clock-on-the-design-of-impact-evaluations-in-criminology-the-case-for-multi-methodology-designs\/","og_locale":"en_GB","og_type":"article","og_title":"Time to Reset the Clock on the Design of Impact Evaluations in Criminology: The Case for Multi-Methodology Designs - BJCJ","og_description":"This paper highlights how qualitative research can enhance causal explanation in impact evaluations and provide additional causal leverage to findings from randomised experiments.","og_url":"https:\/\/mmuperu.co.uk\/bjcj\/articles\/time-to-reset-the-clock-on-the-design-of-impact-evaluations-in-criminology-the-case-for-multi-methodology-designs\/","og_site_name":"BJCJ","article_published_time":"2020-07-23T12:38:32+00:00","article_modified_time":"2022-12-19T12:57:32+00:00","author":"Nathan Monk","twitter_card":"summary_large_image","twitter_misc":{"Written by":"Nathan Monk","Estimated reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/mmuperu.co.uk\/bjcj\/articles\/time-to-reset-the-clock-on-the-design-of-impact-evaluations-in-criminology-the-case-for-multi-methodology-designs\/#article","isPartOf":{"@id":"https:\/\/mmuperu.co.uk\/bjcj\/articles\/time-to-reset-the-clock-on-the-design-of-impact-evaluations-in-criminology-the-case-for-multi-methodology-designs\/"},"author":{"name":"Nathan Monk","@id":"https:\/\/mmuperu.co.uk\/bjcj\/#\/schema\/person\/280e1d3e78088d24e4a8f17aab814061"},"headline":"Time to Reset the Clock on the Design of Impact Evaluations in Criminology: The Case for Multi-Methodology Designs","datePublished":"2020-07-23T12:38:32+00:00","dateModified":"2022-12-19T12:57:32+00:00","mainEntityOfPage":{"@id":"https:\/\/mmuperu.co.uk\/bjcj\/articles\/time-to-reset-the-clock-on-the-design-of-impact-evaluations-in-criminology-the-case-for-multi-methodology-designs\/"},"wordCount":652,"commentCount":0,"articleSection":["Articles"],"inLanguage":"en-GB","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/mmuperu.co.uk\/bjcj\/articles\/time-to-reset-the-clock-on-the-design-of-impact-evaluations-in-criminology-the-case-for-multi-methodology-designs\/#respond"]}]},{"@type":"WebPage","@id":"https:\/\/mmuperu.co.uk\/bjcj\/articles\/time-to-reset-the-clock-on-the-design-of-impact-evaluations-in-criminology-the-case-for-multi-methodology-designs\/","url":"https:\/\/mmuperu.co.uk\/bjcj\/articles\/time-to-reset-the-clock-on-the-design-of-impact-evaluations-in-criminology-the-case-for-multi-methodology-designs\/","name":"Time to Reset the Clock on the Design of Impact Evaluations in Criminology: The Case for Multi-Methodology Designs - BJCJ","isPartOf":{"@id":"https:\/\/mmuperu.co.uk\/bjcj\/#website"},"datePublished":"2020-07-23T12:38:32+00:00","dateModified":"2022-12-19T12:57:32+00:00","author":{"@id":"https:\/\/mmuperu.co.uk\/bjcj\/#\/schema\/person\/280e1d3e78088d24e4a8f17aab814061"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/mmuperu.co.uk\/bjcj\/articles\/time-to-reset-the-clock-on-the-design-of-impact-evaluations-in-criminology-the-case-for-multi-methodology-designs\/"]}]},{"@type":"WebSite","@id":"https:\/\/mmuperu.co.uk\/bjcj\/#website","url":"https:\/\/mmuperu.co.uk\/bjcj\/","name":"BJCJ","description":"British Journal of Community Justice","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/mmuperu.co.uk\/bjcj\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-GB"},{"@type":"Person","@id":"https:\/\/mmuperu.co.uk\/bjcj\/#\/schema\/person\/280e1d3e78088d24e4a8f17aab814061","name":"Nathan Monk","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/secure.gravatar.com\/avatar\/5fc3733cd1573566f62865ea625e7e6ca5e2e6a28ed6e8ad889e373e7c4cae6d?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/5fc3733cd1573566f62865ea625e7e6ca5e2e6a28ed6e8ad889e373e7c4cae6d?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/5fc3733cd1573566f62865ea625e7e6ca5e2e6a28ed6e8ad889e373e7c4cae6d?s=96&d=mm&r=g","caption":"Nathan Monk"},"description":"I'm proud to work for some of the world\u2019s most influential brands that shape cities and define lives: Universities and colleges. I provide advice to forward-thinking senior leaders on how to exceed their organisational targets by creating user-focused, digital-first strategies.","sameAs":["https:\/\/sleek.bio\/n","https:\/\/www.linkedin.com\/in\/nathansmonk\/"],"url":"https:\/\/mmuperu.co.uk\/bjcj\/author\/nathansmonk\/"}]}},"_links":{"self":[{"href":"https:\/\/mmuperu.co.uk\/bjcj\/wp-json\/wp\/v2\/posts\/1574","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/mmuperu.co.uk\/bjcj\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/mmuperu.co.uk\/bjcj\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/mmuperu.co.uk\/bjcj\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/mmuperu.co.uk\/bjcj\/wp-json\/wp\/v2\/comments?post=1574"}],"version-history":[{"count":7,"href":"https:\/\/mmuperu.co.uk\/bjcj\/wp-json\/wp\/v2\/posts\/1574\/revisions"}],"predecessor-version":[{"id":2934,"href":"https:\/\/mmuperu.co.uk\/bjcj\/wp-json\/wp\/v2\/posts\/1574\/revisions\/2934"}],"wp:attachment":[{"href":"https:\/\/mmuperu.co.uk\/bjcj\/wp-json\/wp\/v2\/media?parent=1574"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/mmuperu.co.uk\/bjcj\/wp-json\/wp\/v2\/categories?post=1574"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/mmuperu.co.uk\/bjcj\/wp-json\/wp\/v2\/tags?post=1574"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}