{'fraction_non_alphanumeric': 0.03449839067954123, 'fraction_numerical': 0.015594541910331383, 'mean_word_length': 5.136300417246175, 'pattern_counts': {'":': 0, '<': 4, '<?xml version=': 0, '>': 11, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 7, 'profanity_word_list.json': 0, 'sexual_word_list.json': 1, 'zh_pornsignals.json': 0}}
Development and Validation of a Malay Version of the Questionnaire on Pornography Attitudes and Exposure for Youth in Kelantan

Background The aim of the study is to develop and validate the Malay version of the questionnaire assessing the extent of pornography exposure (PORQUE) among youth in Kelantan. Methods ‘Youth’ was defined as a person aged between 15 and 24 years, while ‘pornography’ refers to any material that depicts sexual activity or erotic behaviour. The development phase consisted of a literature review, an expert panel review, face validation and a pre-test. Fifty college students from a randomly selected higher learning institutions were invited to participate in the pilot test, whereas 150 and 198 different students from the same institutions participated in exploratory factor analysis (EFA) and confirmatory factor analysis (CFA), respectively. Results EFA suggested a five-factor solution with factor loadings ranging from 0.449 to 0.891 and a Cronbach’s alpha ranging from 0.904 to 0.966. The CFA of the attitude questions also proved a good fitting model with good fit indices: comparative fit index (CFI) robust = 0.907; Tucker-Lewis fit index (TLI) robust = 0.901; root mean square error of approximation (RMSEA) robust = 0.073; standardised root mean square residual (SRMR) = 0.060. The factor loadings ranged from 0.544 to 0.906, whereas the Raykov’s rho ranged from 0.886 – 0.974. Conclusion Based on EFA and CFA, the attitude sections of the newly developed Malay version of the PORQUE were found to be psychometrically valid.


Introduction
Pornography has penetrated our society globally in the past 20 years through easily accessible technology, such as smart phones and the internet. Despite being labelled as a taboo or sensitive issue among people in Malaysian society, our youth has been exposed to pornography as early as 11 years old (1)(2). Pornography can be defined as sexually explicit material (SEM) that includes genitals or sexual activities, such as masturbation, oral sex or

Questionnaire Development
Phase 1 of the study was conducted between September 2017 and May 2018. The development of the questionnaire involved a few steps from the Amee guidelines ( Figure 1). A thorough literature review on pornography relatedtopics, such as the prevalence of pornography, pornography attitudes, pornography patterns and factors related to pornography, were conducted. The literature search was carried out using Google Scholar, Science Direct, the National Library of Medicine (PubMed) and Scopus, which covered pornography topics at both local and global levels. Based on the literature review, the first draft of the questionnaire was developed. The experts were i) two public health physicians; ii) two family medicine specialists with interest in sexual health; iii) a psychologist involved in school programmes and iv) a counsellor from a secondary school. The contents of the items were discussed according to the needs and understanding of the youth and took into consideration the suitability and sensitivity of local cultures and religions. The expert panels also examined the content validity of each item in the questionnaire in order to ensure their relevance, clarity, importance and completeness. Upon achieving consensus from the panel experts, the operational definition for pornography used in this study was set: 'any material (e.g. in writing, photography or movies) that depicts sexual activity or erotic unconcealed vaginal and anal penetration, intended to create sexual arousal in its consumers (3)(4)(5).
Worldwide, pornography exposure among youth ranges from 19% in a US study to 70% in a study in Australia (6)(7). On the other hand, the prevalence of intentional exposure was found to be slightly lower, ranging from 7% in a US study to 59% in a study in Taiwan (8). In Malaysia, a population survey revealed an increasing trend of pornography exposure over a six-year period, with higher exposure with increasing age groups (9)(10). Another survey by a Malaysian nongovernmental organisation (NGO) exhibited 80% exposure to pornography, with intentional exposure in half of the respondents (11).
Despite the increasing negative evidence of pornography, studies specifically focusing on pornography are still lacking in Malaysia. There is no reliable measurement tool that can be used to assess pornography exposure, consumption patterns and attitudes on a whole, be it locally or internationally. Most previous studies on pornography have been observational in nature, providing descriptive results (6,7,12). Moreover, some instruments used in other studies have been deemed as not suitable in the Malaysian context due to different levels of acceptance of pornography among different cultures (13)(14).
Hence, this study aimed to develop and validate a tool for the measurement of pornography attitudes and consumption patterns among youth in Malaysia. The outcomes from the study's questionnaire can be used as a guide for establishing a more focused intervention plan for pornography prevention and control among youth in Malaysia.

Methods
This study was conducted in Kelantan, a state located in the north-eastern part of Peninsular Malaysia and involved two phases: i) phase 1, which consisted of questionnaire development and ii) phase 2, which was comprised of validation studies, including exploratory and confirmatory analysis. According to the World Health Organization (WHO), 'youth' can be defined as a person aged between 15 and 24 years, while 'adolescent' can be defined as an individual between 10 and 19 years of age. 'Pornography' refers to any material that depicts sexual activity or erotic behaviour (3). After content validation, cognitive debriefing was conducted, whereby 10 youth were selected by convenient sampling for individual interviews. The purpose of the interviews was to test the face validity of each questionnaire item through an open-ended discussion. The participants were then asked to discuss and interpret each questionnaire item separately, and their responses and understanding of the items were evaluated.
A pilot test was carried out after the questionnaire was revised following face validation. There were 10 institutions identified in Kota Bharu, Kelantan. The pilot testing was conducted in a randomly selected higher learning institution and involved 50 respondents.
behaviour in a way that is designed to arouse sexual excitement'. 'Pornography exposure', on the other hand, refers to viewing or reading pornography at least once in a lifetime, be it intentional or unintentional.
The revised questionnaire on pornography (PORQUE), was set as a self-administered questionnaire, which follows the standard protocol for questionnaire design and testing. It encompassed items related to socio-demographic and family background, family relationship, religiosity, personal risky behaviours (e.g. highrisk behaviour and sexual risk behaviour), internet and phone usage, pornography consumption patterns and attitudes toward pornography. Details of the questionnaire are shown in Table 1. To ensure the suitability of the data, Kaiser-Meyer-Olkin (KMO) and Bartlett's test of sphericity were used (16). KMO values > 0.7 and a Bartlett's test of sphericity with a P-value < 0.05 indicated the data was suitable for analysis. Meanwhile, to determine the number of extracted factors, Eigenvalues > 1.0, parallel analysis and screen plot inspection were performed (17).
The principal axis factoring (PAF) extraction method with Oblimin rotation was applied to extract the factors (18). This extraction method was used because it does not assume normally distributed data (17). The quality of the items was assessed based on factor loadings, communalities values and factor correlations. Factor loadings > 0.5, communalities > 0.25 and factor correlations < 0.85 were considered acceptable values (16)(17)(18). Items with good factor loadings and/or clinical importance were retained and vice versa. Repeat analysis was done whenever the removal of items occurred. For internal consistency reliability, a Cronbach's alpha coefficient of > 0.7 was considered acceptable (19).

Confirmatory factor analysis (CFA)
In the second part of the validation study, the revised PORQUE was administered to another 198 respondents from the same higher learning institution. This study aimed to further explore and confirm the psychometric properties of the questionnaire.
Similarly, the respondents were briefed and consent was obtained from each participant. The attitude questionnaire was analysed by CFA using the Lavaan package version 0.6-3.0 (R Development Core Team, 2016). The model fit assessment was based on the following fit indices and their respective cut-off values: χ 2 P > 0.05, a comparative fit index (CFI) and Tucker-Lewis fit index (TLI) close to or more than 0.95, a root mean square error of approximation (RMSEA) ≤ 0.08 and a standardised root mean square residual (SRMR) ≤ 0.08. Raykho's rho was used for composite reliability (20) using the semTools package version 0.5-0 (R Development Core Team, 2016). A composite reliability value ≥ 0.7 was considered acceptable (20).
During the pilot test, a few items were evaluated: i) technical aspects of the questionnaires (e.g. appropriateness of the wording used, the format of the questionnaires, the flow of the questions); ii) administration process (e.g. length and amount of time taken to complete the questionnaires and flow of questionnaire administration) and iii) data entry preparation (e.g. questionnaire coding, data entry procedure and frequency of non-response items).

Validation Studies
Exploratory factor analysis (EFA) Phase 2 of the study was conducted between June 2018 and September 2018. The first part of the validation study was conducted between June 2018 and July 2018 to explore the psychometric properties of the questionnaire. Another 150 youth were recruited from the same institution at which the pilot study was conducted. The inclusion criteria for the study was youth aged between 16 and 24 years old who consented to participate in the study, whereas the exclusion criteria included those who did not understand the Malay language, were not Malaysian or did not attend classes within the data collection period.
The participants who consented to participate were briefed on the study. Specifically, a few important terminologies related to the questionnaires, such as 'pornography', 'intentional/unintentional exposure' and 'sex education' were explained. The questionnaire was designed to be selfadministered and anonymous. All participants were ensured of their confidentiality and that none of their details (e.g. name, identification or phone number) were recorded. This was done to increase the reliability of the responses.
All data obtained from each participant was entered using SPSS software (version 24, Armonk, NY IBM Corp, Statistical Package for the Social Sciences, USA). The data from Part B of the questionnaire (questions related to attitudes toward pornography) were then transferred to R version 3.5.1 (R Foundation for Statistical Computing, Vienna, Austria). Data exploration and cleaning were conducted to identify incorrect entries missing values and outliers. All negative items scores were reversed prior to analysis. The items in each attitude section were treated as continuous responses to allow for an evaluation of the dimensionality consistent with the mean total household income of RM1,400-RM2,000 per month. Most of the respondents' mothers worked as housewives, whereas their fathers represented several different job categories.
During analysis of the attitude questions, principle axis factoring (PAF) was used with the Oblimin method to test for multi-collinearity. The KMO test was 0.766 and the Bartlett's test of sphericity was significant (P-value < 0.001). The EFA suggested a five-factor solution, whereas the screen-plot inspection suggested a six-factor solution. Thus, the factor numbers were fixed to five, as per our discussion from the experts meeting. Based on the tri-factor model of attitude, the first 20 items were grouped under the Affect factor (with two sub-domains), whereas another 36 items were grouped under the Cognitive factor (with three subdomains). Thus, overall, there were two affect factors (e.g. permissive and non-permissive feelings toward pornography) and three cognitive factors (e.g. permissive perception of pornography, perception of impact of reading or watching pornography and perception of factors contributing to pornography). Based on the EFA, the factor loadings for each item were > 0.3 and the communalities were > 0.25. There were no items with cross loadings. The results in terms of the factor loadings, communalities and Cronbach's alpha are shown in Table 4.
During CFA analysis, the z kurtosis in Mardia's test was > 0.5 (62.67), which means the data did not exhibit multivariate normality. Thus, the robust maximum likelihood (MLR) estimation method was used for analysis. CFA analysis was done by using a five-factor model based on our results from the EFA. In order to obtain a good fit model, 17 pairs of correlated errors were added (as shown in Table 5). Most of the correlated errors took on similar yet different meanings in the sentences. For example, the word membaca or 'reading' was changed to melihat or 'watching' in the following sentences to emphasise the different meanings of the items. These similarities can be seen in correlated error numbers 1 to 13.
Similarities were also observed in other correlated errors (i.e. correlated error number 14: the word meluangkan masa dengan anakanak or 'spending time with children' was changed to rapat dengan anak-anak or 'close with children'; correlated error number 15: the word 'internet' was changed to telefon bimbit or 'mobile phones'; correlated error number 16: the

Questionnaire Development: Content and Face Validity and Pilot Testing
A thorough and extensive literature search of the different subtopics under pornography was helpful in identifying important issues to be highlighted in the formation of constructs and item selection for the attitude questionnaire. Prior to content validation, a draft of the questionnaire was prepared to assist with further discussion during expert meetings. Therefore, during content validation, the panel of experts discussed and judged the initial questionnaire and unanimously agreed to add a few items to the questionnaire while maintaining the good content validity of each item according to their relevancy, clarity, importance and completeness.
During cognitive debriefing or face validation, a few ambiguous terms were highlighted by the respondents such as 'sex education' and 'masturbation'. Thus, the questionnaire was improved by providing additional information on or a definition of such terms. During the pilot test, the duration of response to complete the questionnaire ranged from 10 min -30 min with an average of 20 min. A few technical aspects, such as font size, spacing and questionnaire flow, were changed. For example, questions on pornography consumption patterns were changed to be located after the attitude questions, as they were more related to pornography practice. To avoid the frequency of non-response items, all items under the 'attitude' umbrella were divided into sub-domains to gain better feedback from the respondents. The coding for each questionnaire item was prepared prior to data entry. The details of such questionnaire changes are summarised in Table 2.

Questionnaire Validation: EFA and CFA
The socio-demographic pattern of the respondents for both the EFA and CFA is shown in Table 3. The mean age for both EFA and CFA was 19.6 and 20.4, respectively. Both genders were represented in almost similar proportions in the EFA, whereas, in the CFA, male respondents comprised two-thirds of the total respondents. The respondents were all Muslims, the majority of which resided in Kelantan. In terms of parents' education, the majority of the respondents had parents who had at least completed secondary school, which was

Discussion
The main objective of this study was to develop a new Malay version of PORQUE that addresses the attitudes, consumption patterns, and factors associated with pornography of youth. This questionnaire was different from those in previous studies in Malaysia, one of which used general questions on pornography consumption as part of health screening for adolescents (21), while another was a qualitative study that focused on sexual initiation among adolescents rather than pornography (22). Overall, we managed to complete two phases of this study with adequate sample and responses to produce a valid tool to assess the attitudes and consumption patterns related to pornography among youth. word anak luar nikah or 'out of wedlock child' was changed to hamil luar nikah or 'premarital pregnancy'; correlated error number 17: the word sex bebas or 'promiscuous sexual intercourse' was changed to 'pedophilia'.
Following the addition of the correlated errors, as shown in Table 5, the model showed demonstrated good fit indices: P-value (Chi-square) < 0.001; CFI robust = 0.907; TLI robust = 0.901; RMSEA robust = 0.073; and SRMR = 0.060. The correlation between the Affect factor and Cognitive factor (with each sub-domain) ranged from 0.036 to 0.551. Details on the inter-factor correlations are explained in Figure 2. All factor loadings for the items were > 0.5 and the composite reliability of all factors was > 0.7 ( Table 6).
The overall results for the CFA are illustrated in Figure 2.      Based on a thorough questionnaire validation, we found that the assessment of the psychometric properties in the questionnaire was good when applied to the attitude section. The analysis of the attitude questionnaire resulted in a good-fitting five-factor model based on the EFA and CFA, in which two factors were clustered under the Affect model and another three under the Cognitive model (26).
The five main domains included in the attitude section were 'permissive feelings toward pornography' (14 items), 'non-permissive feelings toward pornography' (6 items), 'permissive perception of pornography' (14 items), 'perception of impact of pornography' (11 items) and 'perception of factors that contribute to pornography' (11 items). The psychometric property results for the domains 'permissive feelings toward pornography' and 'non-permissive feelings toward pornography' were consistent with findings from previous observational studies (6)(7)12). However, we were unable to compare the other three domains, as no similar studies had been conducted to assess the psychometric properties of such items.
We identified a few limitations in this study: first, it used convenient sampling; thus, even though the confidentiality of the study was ensured, there was still the possibility of social desirability bias, as the respondents may have felt pressured to answer the questionnaire due to peer factors and thus did not respond to the questions accordingly. Secondly, as this study relied on self-reported measures to maintain the anonymity of the respondents, we were unable to verify the responses, which may have limited our interpretation of the data.

Conclusion
The newly developed PORQUE is reliable in terms of its satisfactory EFA and CFA results and is thus valid for use among Malay youth in Malaysia. However, due to the homogeneity of our respondents, this study may need to be repeated to generalisability to other target groups and races. consisted of seven segments: socio-demographic and family background, family relationship, religiosity, personal risky behaviour, internet and phone usage, pornography exposure, and consumption patterns and attitudes toward pornography. The socio-demographic pattern of the respondents during the study's EFA showed an equal gender distribution, whereas, in the CFA, the male respondents comprised twothirds of the total respondents. This could be explained by the fact that the participants were recruited via convenient sampling. The first part of the validation, EFA, exhibited a good psychometric property of the attitude questions: EFA suggested a five-factor solution (two affect domains and three cognitive domains) with a good range of factor loadings and Cronbach's alpha. The second part of the validation of the attitude questions, CFA, also exhibited a good fit model with good fit indices. The factor loadings and Raykov's rho also showed a good range.
During the development process, much emphasis was placed on the content validation of the experts, whereby generations of the items were discussed in greater depth in each section. For example, each item was checked for its relevancy, clarity, importance and adequacy. Thus, each sentence was designed to be brief, clear and simple enough for the youth to understand and provide an appropriate response (15). The word 'pornography' was changed to bahan-bahan lucah or 'explicit/ obscene materials', as it this was thought to be more palatable in Malaysian culture. During the development of the items for the attitude questionnaire, we noted the possibility of having two questions for the same item (23). For example, items with similar content were split into two separate questions for membaca 'reading' or menonton 'watching'.
Due to the sensitive nature of this study, the questionnaire was designed to enable the researchers' ability to detect a 'faking index' (i.e. untruthful responses given by participants) to avoid social response bias (17,(24)(25). For example, during the development of the questionnaire for pornography consumption patterns, questions related to pornography exposure, intentional or unintentional use and consumption patterns were provided continuously without provisional instructions. This approach was used to avoid prejudice among respondents and encourage them to answer the questions without hesitance.