{'fraction_non_alphanumeric': 0.040337608242902556, 'fraction_numerical': 0.013208374438233037, 'mean_word_length': 5.131384408602151, 'pattern_counts': {'":': 0, '<': 5, '<?xml version=': 0, '>': 0, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 5, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
mHealth in Urology: A Review of Experts’ Involvement in App Development

Introduction Smartphones are increasingly playing a role in healthcare and previous studies assessing medical applications (apps) have raised concerns about lack of expert involvement and low content accuracy. However, there are no such studies in Urology. We reviewed Urology apps with the aim of assessing the level of participation of healthcare professionals (HCP) and scientific Urology associations in their development. Material and Methods A systematic search was performed on PubMed, Apple's App Store and Google's Play Store, for Urology apps, available in English. Apps were reviewed by three graders to determine the app’s platform, target customer, developer, app type, app category, price and the participation of a HCP or a scientific Urology association in the development. Results The search yielded 372 apps, of which 150 were specific for Urology. A fifth of all apps had no HCP involvement (20.7%) and only a third had been developed with a scientific Urology association (34.7%). The lowest percentage of HCP (13.4%) and urological association (1.9%) involvement was in apps designed for the general population. Furthermore, there was no contribution from an Urology society in "Electronic Medical Record" nor in "Patient Information" apps. A limitation of the study is that only Android and iOS apps were reviewed. Conclusions Despite the increasing Mobile Health (mHealth) market, this is the first study that demonstrates the lack of expert participation in the design of Urology apps, particularly in apps designed for the general public. Until clear regulation is enforced, the urological community should help regulate app development. Maintaining a register of certified apps or issuing an official scientific seal of approval could improve overall app quality. We propose that urologists become stakeholders in mHealth, shaping future app design and promoting peer-review app validation.


Introduction
Smartphones and tablets are almost ubiquitous in our society and represent a popular method of accessing information. Smartphone applications (apps) are increasingly playing a role in healthcare [1]. Mobile Health (mHealth) comprises "medical and public health practice supported by mobile devices" [2]. The total mHealth market revenue is estimated to grow by about 61% to reach US$26 billion, at the end of 2017 [3]. Moreover, previous studies report close to 100,000 medical apps available on the two leading software platforms, iOS (Apple) and Android (Google) [3]. That number is expected to grow even further, as both Apple and Google have announced mHealth to be a top-priority [4,5]. With the increasing number of available apps, there is a growing concern about their quality and safety, as there are no industry standards, no scientific guidelines and no independent medical app regulation [6][7][8].
Recently, papers assessing apps in various medical fields have been published, detailing the myriad of options available, which range from health and fitness apps for the general public, to medical education and teaching aids, as well as electronic health records and even augmented reality software [1,[9][10][11][12]. The clinical use of smartphone as diagnostic tools in Dermatology is one of the most common, but it is not without pitfalls: an app that claimed to quantify skin cancer risk mislabeled 80% of textbook melanomas [13,14].
Apps designed for surgical specialties, such as Anesthesiology, Plastic Surgery and Neurosurgery, have also been scrutinized, with similar conclusions: app development offers great potential, but lacks standardized regulatory procedures [15][16][17]. Even though there have been papers demonstrating the use of apps in Urology, to our knowledge, there are no published studies reviewing healthcare professional involvement in apps specifically designed for Urology [18,19]. This study had two aims. First, to review Urology apps, mainly in regards to mobile platform, target audience, developer, type of app, app category and price. Second, to identify which apps had documented HCP involvement and which were developed in collaboration with a scientific Urology association.

Methods
Three graders (an Urology resident and two Urology specialists) conducted a systematic review on PubMed, Apple App Store (iOS) and Google Play Store (Android), for Urology-themed apps, between September of 2014 and January of 2015. On PubMed, the searched terms were "Urology" and "mobile", "application", "app", "apps", "mHealth", "eHealth", "iOS", "iPhone", "iPad", "Android", "tablet" and "smartphone". Results were filtered for articles related with Urology apps that were available for download on the Apple App Store and on Google Play Store.
A similar query was also performed on both stores, for Urology-related apps. Android apps were searched at the Google Play online store. For iOS-based applications, the search was performed using iTunes v11.3.1 for Mac OS X (Apple Inc., Cupertino, CA, USA). All apps with "Urology" in their metadata (title, description, keywords and version history) were scrutinized. From the search results, graders included all apps that were available in English and designed specifically for Urology (e.g. "AUA Core Curriculum Mobile"). Exclusion criteria include those related with general medicine (e.g. "Clinical Tests & Procedures") or other fields (e.g. "Anatomy Flash Cards"), and apps that only had product advertisement, i.e. apps that only promoted pharmaceutical or medical equipment (e.g. "Actient Pharmaceuticals"). All three graders universally agreed on the criteria.
Based on all available information, the three reviewers decided on one of the following apps' type: Reference, Guidelines, and Quiz/Exam (e.g. Urology textbooks, Guidelines from an urological association); Conferences, Urological Societies/Associations, Journals and Institutions (e.g. "EAU Stockholm 2014", "AUA Member Search"); Calculators (e.g. "TNM Urology"); Electronic Medical Record/Diaries (e.g. "Bladder Pal"); and Patient Information (e.g. "Dealing with Prostate Cancer") ( Table 1). They also determined the target audience (i.e. apps designed specifically for healthcare professionals or suitable for the general public). Moreover, they gathered data on the type of developer (i.e., apps developed by an individual or an organization) and the app's category. The app's category is chosen by the developer from a predetermined list of options, and represents the category where the app is available in the Store. Developers are required to select the category that best describes the app. Possible categories are Medical, Books & Reference, Education, Health & Fitness, Business, News & Magazines, Social, Utilities, Entertainment and Games. The app price (free or paid) and the actual price in dollars were also recorded.
Graders considered that there was involvement by HCP (e.g. urologists, other medical doctors, pharmacists, and specialist nurses) or a scientific Urology association in the apps' design when it was mentioned in the app's description or website. Apps were not purchased or downloaded.
First, a descriptive overview of available apps was performed. Second, all apps included in this review were assessed regardless of being available on both platforms or exclusively on Apple App Store or Google Play Store. When an app was available in both Stores, it was evaluated only once. However, some apps available in both platforms had differences between the two versions, namely in price and app category. When the price of the app was not the same on both Stores, the average price was calculated. When the app category was not the same on both platforms, the most recent version was considered.
To evaluate an association between targeted audience and healthcare professional or urological association involvement in the app development, the app price, and the developer, we used the chi-square test of association.
To analyze a relationship between the type of application and the involvement of a healthcare professional or an urological association in the development of the app, we calculated the chi-square test of association.
Analyses were performed using SPSS v20 (IBM Corp., Armonk, NY, USA). Statistical significance was set at p < 0.05 for all analyses.

Results
From the initial 372 apps (Android = 250, iOS = 122), we excluded all apps that were not available in English, not specific for Urology and that were only product advertisement (Fig 1). Table 1 lists all included apps and Table 2 displays the main characteristics of the surveyed apps. A complete assessment of all urology apps, including its description and information Of the 150 individual apps, there were more apps targeted at healthcare professionals (72.7%) and published by organizations (88.0%). The most common type of app was "References, Guidelines, and Quiz/Exam" (36.7%), which included, for example, Urology textbooks and atlas.
The vast majority of apps were free (71.3%). The average price of paid applications was 9.15 ±14.09 dollars, but there was a large range, from 0.99 dollars (five apps) to 71.94 dollars ("Urological Surgery", 71.94 dollars). The most expensive apps were "References, Guidelines, and Quiz/Exam". Taking into account the available free apps, the average app price dropped to 2.62 ± 8.55 dollars.
One in five apps had no documented HCP involvement in their design (20.7%). Moreover, only one-third of all reviewed apps had been developed in collaboration with a scientific Urology association (34.7%).
Furthermore, there was a statistically significant difference between target audience and HCP involvement in apps' design (p<0.001): only 13.4% of all apps designed with input from a HCP were targeted for the general population. Additionally, there was a statistically significant difference between target audience and urological association involvement in the apps' design (p<0.001). Similarly, the lowest percentage of urological association involvement in apps' design was in apps designed for the general population (1.9%) ( Table 3).
Moreover, there was statistically significant differences between apps' type and HCP (p<0.001) and urological association (p<0.001) involvement in apps' design. The lack of HCP involvement in app development was highest in Patient Information apps (64.3%) and Electronic Medical Record/Diaries (40%). No Electronic Medical Record/Diaries nor Patient Information apps were developed with documented involvement by any scientific Urology association (Table 4).
There were no statistically significant differences between target audience and cost (free or paid, p = 0.13) nor developer type (individual or organization, p = 0.08). Complete list of all included apps, its availability and the participation of a HCP or a scientific Urology association. A complete assessment of all urology apps, including its description and information about its creators, is available as supporting information.  The maximum, minimum, and mean values are presented for the actual price. c The involvement of a healthcare professional was assumed if there was reference to an urologist, other medical doctors, pharmacists or specialist nurses in the app.

Discussion
To our knowledge, this is the first study that completely identifies healthcare professional involvement in apps specifically designed for Urology and hence can serve as a trigger for urological societies to further explore the opportunities and overcome potential pitfalls of mHealth in Urology. The mHealth market is mostly self-regulated, but there is a need for an independent assessment of available apps, to prevent both HCP and the general public from apps of using questionable reliability. The current study shows that there is clearly a deficit of expert input in Urology apps, as more than one fifth of all available apps did not have any involvement of HCP and only a third had the involvement of a scientific Urology association. These results are slightly worse than those from other areas, but this seems to be an issue across multiple medical fields [20][21][22].
Google Play Store has more Urology apps than Apple App Store. One possible explanation for this difference is the contrasting app approval process on both platforms: Android apps are automatically approved. However, iOS apps need to respect Apple's Review Guidelines and are only published in the App Store after technical approval by Apple staff [4]. For example, apps that share personal data without user consent are rejected [4].
The present study shows that the most common type of apps was "References, Guidelines, and Quiz/Exam" and most apps were available in the "Medical" category of the store, which is consistent with other reviews [13,20].
Even though most apps were targeted at professionals, one fifth off all apps in our review are designed for patient information, which stresses the importance of safety even further, knowing that these users often lack scientific judgment.
Moreover, the involvement of commercial companies in this type of media has been questioned before, with worries about their funding and purpose [23]. A particular concern is the potential bias in product promotion, which can ultimately create conflicts of interest between the developer, healthcare professionals and the end user. Development of health apps should always involve healthcare experts. However, in our review, medical calculators had an unexpectedly low proportion of HCP participation in their design. This lack of involvement is also evident in patient-targeted apps, particularly in Electronic Medical Records and Patient Information apps.
Even when there was reference to a HCP or an urological society involvement in the app design, it was not possible to systematically assess their level of responsibility, either as an external advisor, major stakeholder or sole author. Moreover, we could not find any available tools or evidence on how to quantify this information in a reproducible method.
This issue has raised attention of some public entities, namely the National Health Service in England, which curates an online Health Apps Library, and also private companies (e.g. Happtique MobileHealth Source), which are developing certification processes for mobile apps, with the aim of regulating the mHealth market [24].
With the growing number of available apps, the challenge is finding safe and well-designed apps. HCP and scientific Urology association involvement can act as a quality check, which is of paramount importance, not only for healthcare-targeted apps, but even more so in apps designed for the general public.
In the same way that doctors involvement in social media (SoMe) has been the focus of attention and recommendation by urological societies, medical app development should become subject to the same regulation, and Urology must not be left out [25][26][27][28][29].
mHealth has the potential to be an important tool in the future of Urology. However, it is critical that scientific accuracy, patient privacy and user safety are assured. Even though some of the issues may not be within the competence of scientific Urology associations, they can still take an active role in this subject. mHealth app development should be seen by urologists as an opportunity to provide greater care to our patients and better software and knowledge to our peers. Even though this paradigm might require learning some new tools and skills, engaging in app development can be a fulfilling opportunity for a alternative medical interaction.
The present study certifies the lack of healthcare professional involvement in Urology apps. Considering that apps included in this review represent less than 0.2% of available medical apps and that there are more breast cancer (total = 178, Android = 118, iOS = 59) apps than Urology apps in total, mHealth is an untapped potential in our field and further investigation is mandatory to clarify the role that apps may play in Urology [30].
This study has some limitations. We could not perform analyses on the mobile stores' rating and review data because, unlike Google Play Store, the Apple App Store does not show the rating of all apps. Another limitation is that only the Android and iOS apps were reviewed, even though there are other mobile app stores, namely Microsoft and Samsung. However, Apple's App Store and Google's Play Store are by far the most popular platforms. We only searched for apps that included "Urology" in their metadata. Therefore, some Urology apps, which did not include it in the description of the app, were not included. Even though all graders had to agree on the app's type classification, it remains subjective, which is a potential limitation. However, there is no standardized classification scheme available. Healthcare professional and urological society involvement was structured as a binary variable (i.e. yes/no), but was not quantified.

Conclusion
Apps represent a new opportunity to enhance care in Urology. Possible uses range from augmented reality apps that can be helpful in a clinical or surgical setting, to electronic diaries that aid in treatment monitoring and even health promoting apps. Even though there are, at the moment, 150 Urology apps, covering a wide range of subjects and directed at a diverse audience, there is room for improvement.
Until clear regulation is enforced, either by government health authorities or independent organizations, the urological community should adopt an active role as soon as possible, in a manner similar to what was done regarding SoMe [25][26][27][28]. Even though it is impossible to verify all available apps, maintaining a peer-reviewed register of certified Urology apps or issuing an official scientific seal of approval, could influence overall app design and, consequently, improve urological mHealth solutions.
Supporting Information S1 Table. List of all included Urology apps. A complete assessment of all urology apps, including its description and information about its creators, is available as supporting information, and can be accessed at http://dx.doi.org/10.6084/m9.figshare.1363120 (DOC)