text:
Building a Large Scale Climate Data System in Support of HPC Environment
- Dale Franklin
- 1 years ago
- Views:
1 Building a Large Scale Climate Data System in Support of HPC Environment Feiyi Wang 1, John Harney 1, Galen Shipman 1, Dean Williams 2, and Luca Cinquini 3 1 Oak Ridge National Laboratory, Oak Ridge, Tennessee Lawrence Livermore National Laboratory, Livermore, California Jet Propulsion Laboratory, Pasadena, California Abstract The Earth System Grid Federation (ESG) is a large scale, multi-institutional, interdisciplinary project that aims to provide climate scientists and impact policy makers worldwide a web-based and client-based platform to publish, disseminate, compare and analyze ever increasing climate related data. This paper describes our practical experiences on the design, development and operation of such a system. In particular, we focus on the support of the data lifecycle from a high performance computing (HPC) perspective that is critical to the end-to-end scientific discovery process. We discuss three subjects that interconnect the consumer and producer of scientific datasets: (1) the motivations, complexities and solutions of deep storage access and sharing in a tightly controlled environment; (2) the importance of scalable and flexible data publication/population; and (3) high performance indexing and search of data with geospatial properties. These perceived corner issues collectively contributed to the overall user experience and proved to be as important as any other architectural design considerations. Although the requirements and challenges are rooted and discussed from a climate science domain context, we believe the architectural problems, ideas and solutions discussed in this paper are generally useful and applicable in a larger scope. I. INTRODUCTION The Earth System Grid project [1] aims to deliver a servicebased platform for worldwide researchers to populate, collaborate, disseminate and analyze climate data as part of the scientific discovery process. The ESG project traces its origins back to 1999, when a prototype focusing on large dataset movement and replication was produced. Thanks to technological advances in that time and the growing need for one-stop site for climate science data, its architecture and design have undergone several iterations since. As a result, ESG has grown into a portal-based, fully federated distributed data management system. The term federation reflects two salient features in ESG: (1) the user registration and access control is federated across organizational boundaries with single sign-on support, and (2) the metadata catalogs that constitute critical scientific data holdings (besides the raw data) are distributed and harvested such that each participating organization s gateway can present a unified view (browse and search) on the dataset under ESG management. As a multi-institution, cross-disciplinary project, ESG has made a significant impact to the climate community: 23,000 users registered from over 2,700 sites in 120 countries, over 1PB data downloaded, over 600 published papers, serving as one of the foundational vehicle for data exchange that supported the Intergovernmental Panel on Climate Change (IPCC) 4th Assessment Report (AR4) and will support the upcoming fifth phase Coupled Model Intercomparison Project phase 5 (CMIP5) [2]. As we stand to move ESG infrastructure forward and meet the challenges of upcoming exascale computing and speed up scientific discoveries, it is imperative for us to pause and reflect. This paper reports our experience on the design, implementation and operation of the ESG system. The paper is organized as follows. Section II gives a brief overview of the current ESG architecture. Section III discusses the data characterization in the context of the data life cycle of a high performance computing (HPC) environment and implications. Section V presents the challenges and requirements of data population. Section VI reflects on the current process for data search and discovery. Finally, we conclude the paper in Section VII with a summary and avenues for future works. LBNL PNNL UK II. ESG ARCHITECTURE Germany LLNL Service-based Federation NCAR Fig. 1. ANL Data Node ORNL Austrilia Parallel File System (Spider) ESG Architecture compute nodes At its core, ESG is a federated and distributed data system. Distributed means that the data can be hosted at geographically dispersed locations. Federated means the distributed data are conceptually joined together as one centralized archive, where users can search and discovery those data from any number of ESG gateways. In short, the basic setup and data flow for ESG works as follows: each major site can have a gateway, which essentially runs ESG portal Data centers that are collecting or generating and hosting data are responsible to scan and generate metadata for the dataset, and then publish to one of those gateways. All the ESG gateways share a trust relationships. The implication is that metadata can be harvested and
2 Data shared among gateways. As a result, the user can search and download a dataset from any gateway once they have been authenticated by the system. The following provides a subset on features that developed by various ESG teams: Federated Security Layer: Large scale distributed data systems often contain a security layer that adds an additional degree of complexity for both data providers and potential users. ESG abstracts this complexity by providing support for both single sign-on authentication and fine-grained data access control. Once users are signed into the gateway cloud, they may seamlessly search, discover and download data from anywhere on the federation, regardless of whether data is physically stored locally or remotely at another location. Bulk Data Transfer: Distributed frameworks like ESG often require support for bulk data transfer, where largescale datasets are moved across networks around the world. Led by the ESG team at Lawrence Berkeley National Laboratory (LLNL), the Bulk Data Transfer Mover (BDM) [12] provides the capability of transferring files using parallel TCP streams and adjusting optimal levels of concurrency based on bandwidth capacity as well as achievable bandwidth on the wide area network. Transfer Management: The configuration steps needed to leverage high performance transport protocols and tools such as GridFTP [4] are often cumbersome and errorprone. Led by the ESG team at Argonne National Laboratory (ANL), Globus Online [9], using the software as a hosted service paradigm has greatly reduced the overhead required for transfer management setup. Integrated into the ESG software stack, Globus Online provides another option for data access. III. THE LIFECYCLE OF SCIENTIFIC DATA IN HPC In HPC environments such as the National Center for Computational Science (NCCS) environment at the Oak Ridge National Laboratory (ORNL), the lifecycle of scientific data follows a very structured workflow, as illustrated in Figure 2. The first step involves the creation of the data itself by domain scientists. In this stage, experts design carefully conducted experiments. Tasks for theses experiments vary, and may include the gathering of initial conditions, validating results against data extracted from instrument observations, or optimization of models through iterative testing. The experiments usually run scientific applications on powerful supercomputers such as the Jaguar [5] supercomputer at ORNL. The results of these experiments, which may be conducted instantaneously or over a substantial period of time, normally generate data that exceed 100s of Terabytes (TB) or even Petabytes (PB). Once the experiments have completed the data providers may include additional information about the data (e.g., provenance information). The data is now prepared to enter the data dissemination and sharing stage. In this stage, two processes occur in parallel. In the first process, data is transferred to permanent storage (especially in HPC environments), which are typically long-term storage systems such as the HPSS system at ORNL. In the second process, metadata extracted from the generated data, is sent to the data management and portal system so that it may be indexed and subsequently discovered by other users. After these tasks are completed, the metadata are ready to be consumed by scientists around the world. These scientists can then search and download either part or all of the data for further analysis. Jaguar Fig. 2. Re-runs Checkpoint Data Spider Center Wide File System 10PB, 240GB/s Bandwidth Inter-Model Comparison Model Verification and Analysis Index and search (facets, geospatial, temporal) Data HPSS ESG System Model Data Observational Data Supporting End-to-end Scientific Discovery We believe that the workflow of the data lifecycle in an HPC environment implies four distinctive characteristics about scientific data in general that underpin the overall design considerations of the ESG data management system. These characteristics are data scale, data dispersion, data diversity, and data access control. We briefly discuss these characteristics in the proceeding subsections. A. Data Scale At leading computing facilities such as the US Department of Energy (DOE), supercomputers (e.g., Jaguar at ORNL) are running simulations at unprecedented scales. In this context, we define scale as both the size of the dataset and the number of files generated from running these simulations. For example, a single run of FLASH astrophysics code produced 74 million data files in The upcoming CMIP5 collaborated climate data model runs are expected to generate between 5 to 10 PB of data, with over 3 PB of core data replicated at five sites for greater access and backup. The effects of this data explosion can also be corroborated by usage observations seen in Figure 3. It clearly shows the trend of acceleration of data avalanche: reaching 1 PB took us 101 months, 2PB only 20 months etc. Fig. 3. Exponential Storage Growth at ORNL
3 This dramatic increase in the scale of data requires us to adopt a modern, restructured I/O model. At ORNL, the ESG team has constructed such a model consisting of two stages. The first stage is the use of a high-performance diskbased parallel file system, know as the Spider system [10]. In this system, the peak aggregate throughput can be as high as 240 MB/s. However, Spider is designed to be a capability system, and not a capacity system. Even with 10 PB capacity, it is mainly used as a scratch space for scientific applications. We rely on HPSS for long-term data archiving solution. B. Data Dispersion Modern climate research efforts often require international collaboration. For example, over 20 climate modeling centers around the world came together to agree upon a set of coordinated climate model experiments, known as the Intergovernmental Panel on Climate Change Fourth Assessment Report (IPCC AR4) and, subsequently, the Coupled Model Intercomparison Project (CMIP5), aim to address scientific questions and obtain a general understanding of the Earth s climate [14]. Each group tackles some portion of this experiment and shares the results. The internationally produced data island needs to be connected, metadata harvested, shared and searchable through a coherent interface - thus, the current twolevel architecture design was conceived: a physical (i.e. data) node that hosts the data and a virtual (i.e. gateway) node that presents metadata through a THREDDS catalog service [7]. A publisher service harvests metadata from the data node and makes this information available to the gateway node, where metadata may be federated and prepared for discovery. C. Data Diversity The HPC data life cycle should be designed to support a variety of data formats and metadata structures. In other words, it is highly desirable for a system to be flexible, or diverse, so that data need not to be in a specific format for permitted access into the system. The climate sciences community, for example, has a broad spectrum of sub-branches. The modelling community utilizes the NetCDF Climate and Forecast (CF) Metadata structure [8] to define metadata that provide a definitive description in what data each variable represents, and of the spatial and temporal properties of the data. Other bodies of climate-related data, however, utilize other representations. Geographic data, for example, uses the (Federal Geographic Data Committee) FGDC standard for metadata description. This characteristic embodies the inherent open nature of data frameworks in general both the ingress (i.e., the consumers of the data) and the egress (i.e., producers of the data) should be open-ended and designed for extension. We will revisit this issue in further detail in both Sections V and VI. D. Data Access Control Despite the data sharing and dissemination characteristics that a distributed and federated system like ESG exhibit, there are concrete reasons for data access control policies that promote security. Institutions such as ORNL often leverage internal resources, such as HPSS archiving systems, that require complex, two-factor authentication codes for access. Other institutions may have other elaborated internal security protocols and access control policies. These policies may include a number of different criteria, including authenticating which data to share, whom to share that data with, or the usage intentions of that data. The tension between the desire to share and the desire to control place additional burden on system architecture design and potentially has ramifications on both data population and deep storage access. To summarize, four intervening issues emerged from this context: driven by the data scale comes to the need for deep storage. The requirement on data access control complicated the workflow of both the data population as well as deep storage access. These are the subjects of discussion in the following sections. IV. DEEP STORAGE ACCESS: CHALLENGE AND SOLUTIONS In the preceding sections, we hinted that there may be two reasons for utilizing deep storage (e.g. tape libraries) in the context of persisting scientific data as part of ESG. First, both near and long-term climate data needs far exceed the current resources available for ESG online. To address this shortcoming, we may utilize mature high performance systems such as HPSS, which have 10s of PB in storage capacity for long term storage archival purposes. Second, large scale computing environments, such as the Leadership Computing Facility at ORNL, often design online disk storage focusing on capability not capacity. For example, the high performance Spider filesystem [10] at ORNL is primarily used as scratch space simulation results are typically temporary written to this space only to purged periodically. Spider users are often asked to transfer their data to HPSS prior to this purging. Internet Fig. 4. DMZ Storage Resource Manager (HPSS Plugin) ESG Grid FTP Server srm requests Grid FTP Transfer Controlled Access proxy Tmp Space HSI copy Controlled Access to Deep Storage System However, accessing and sharing such data in a systemagnostic way proves to be a challenge. Specifically, there are two aspects of the challenge that needs to be addressed. First, a mechanism is required to bridge file and space management strategies between the ESG gateway and backend storage systems. This is due to the fact that a disparity exists between the front end storage (e.g. HPSS), both in resource capacity and the manner in which files are handled. Second, there are data transfer issues due to the constraint of access control. For example, it is common in HPC environments that data requests
4 can only be initiated from within the internal network. This constraint naturally stems from security policies that may exist in institutions that participate in ESG. One potential solution to these issues is to leverage the hierarchical storage system (HSM) [6] technique, which automatically moves data between high-cost and low-cost storage media. This technique is commonly supported by many commercial products such as IBM Trivoli Storage Manager, HPSS, EMC DiskXtender, SGI Data Migration Facility etc. It is, however, not currently supported by the Lustre filesystem [15], which is one of the most widely adopted distributed parallel file systems in HPC centers around the world. While there are several activities within the Lustre community working to develop this feature, it is still not mature enough for production use. The current solution ESG has employed is to leverage the Storage Resource Manager (SRM) [11], which is designed to abstract the complexity of these types of file transfers from potential users. In this configuration, ESG users will be notified that there will be a delay in their ordered data s delivery. During this time, the backend will be preparing the dataset by transferring from long term storage to ESG storage. When finished, the backend sends messages to the user that the data is available for download. This workflow is illustrated in detail in Figure 4. The flow of operation corresponds to the following: The user browses the ESG gateway and selects the files to download. ESG gateway support the notion of access points, where SRM is just one of such types. Access point of SRM and Local Disk are transient state as the state changes pending on the data availability. The gateway communicates with Storage Resource Manager with a list of file URLs based on user s selection. Storage Resource Manager takes over the file transfer and notifies the gateway after the offline data is fetched over. can query the status of the request and notify the user the readiness of data when they are in place for serving. The file access point at this stage will be presented as on disk, as it should be. The storage resource manager such as BeStMan brought in two important mechanisms. First, it provides dynamic space reservation and utilization. You can pre-allocate a chunk of disk space as temporary space for serving fetched data; and unclogging the storage space based on usage and access pattern. This is in essence, a form of cache management. The second mechanism is a plugin framework, where we can write customized plugin module to access the backend storage system. This capability is paramount for us to address the second challenging aspect of working with institutional HPC system: conforming to security and access constraints. As shown in Figure 4, we have designed and developed a proxy module at the backend. It polls periodically from SRM plugin for SRM data request, and invokes the backend transfer (hsi, a data transfer tool for HPSS). We leveraged GridFTP for high performance data movement. We are also exploring Globus Online to simplify the process of setup and configuration. This architecture and solution to deep storage access method have a reaching impact on how scientists publish and disseminate their dataset, and how metadata is harvested as well, which is the subject of next section. V. DATA POPULATION As implied in Figure 2, the next major step in the data life cycle is for users to validate, organize, and subsequently, publish the data to some accessible component (e.g. web portal) for peer review. Figure 5 shows major flow and components of the current ESG publication framework design. Fig. 5. esg.ini models standard names Raw Data esgpublish Full metadata Node DB Partial metadata Thredds catalog Hessian Binary Protocol Overview of Current Publisher Structure At its core of this publication framework are metadata harvesting and THREDDS catalog generation. Metadata are first extracted and persisted into a local database from raw data (assumed to be placed in some standard format such as NetCDF). Some of this extracted metadata are output into a THREDDS catalog. These generated THREDDS catalogs are pushed to remote gateway for further indexing and ingestion, and presented through the web front end. Revisiting HPC data lifecycle and viewing the problem from perspective of scientific users, we have the follow reflections and improvements to share on the framework design: A. Flexible data organization: As an international collaborative project, CMIP5 showcased the design of controlled experiments with preciseness: it defines an extensive list of variables [3] described as standard output, results from extensive discussion from sub-discipline experts and interest groups within climate modeling community. Along with it, it defines Data Reference Syntax Document [13] for file name encoding, directory structure encoding, publicationlevel dataset id encoding, etc. This is necessary and a must for inter-model comparison. At the other end of the spectrum, we have scientific users who like to make use of ESG publisher and gateway except that they have a very unstructured layout with mutually agreed protocol among circle of colleagues for understanding the dataset. Publisher framework needs to accommodate the needs of both classes of users. B. Metadata extensibility: We have discussed the scientific data diversity in Section III-C. In addition to well-defined data formats such as NetCDF and its CF extension, there are also a wide range of ad-hoc provenance data that scientists like to publish along with raw data. They are in the form of plain text, MS word, static generated plots and pages that describe the running environment, initial conditions, compiler version, extra tweaking, diagnostic
5 results, which are critical to the understanding of the output and maybe necessary for reproducing the results. The publishing framework needs to be open-ended on both inputs and outputs. C. Ease of use: we believe ease of use is paramount for publishing tool to support daily activities of scientific users. Being accustomed to utilizing the latest advances in technology, HPC users exhibit a greater level of tolerance for intuitive tooling support. However, as complicated as the supporting workflow might be, or as many as the constraints it must work within, we shall make every engineering effort to make simple things simple, and make complicated things possible. One of the proven techniques we can leverage is convention over configuration - i.e., make sensible default that cater to the particular working environment. All of above issues are being tackled by the ORNL team. Next section will touch on our solutions on metadata extensibility as well as easy of use in the context of data indexing and search. Due to limited space, we will skip the rest of the design details. VI. DATA INDEXING AND SEARCH The final phase of the ESG data portal lifecycle illustrated in Section III is the data dissemination stage. This stage comprises several services that are vital for completion of the scientific data life cycle in HPC. In simplest terms, dissemination involves the explicit exchange of data being made available by data publishers and data being discoverable by clients. The manner in which this exchange occurs is relatively straightforward. Publishers make their data discoverable by publishing metadata descriptions about their datasets. This metadata is ingested by some common search index, where it may be made available to clients whom perform queries over the metadata to find specific datasets that may interest them. The clients are then free to interpret the data to build future experiments (perhaps re-entering ESG s HPC scientific data life cycle). ESG has placed considerable time and effort in creating a robust data dissemination environment. In particular, we believe that our search and indexing architecture abides to the primary requirements that both data producers and data consumers demand easy-to-use, intuitive tools to ensure that their proper participation in the workflow. We believe that data producers emphatically favor search indices that support a wide, diverse range of metadata ingestion. This eases the burden of making their data discoverable to potential interested consumers. Consumers, on the other hand, stress system usability. We outline both criteria in detail in the following subsections. A. Addressing ESG Data Producer Requirements: Metadata diversity One of the design artifacts of current publishing framework is its close coupling on modeling data. THREDDS Catalog OAI-DIF Generic Format Metadata File Input Fig. 6. Metadata Format Plugin ESGF Harvester Framework Search Index Overview of Current Harvester Framework We have designed a new metadata diversity framework that promotes a more positive metadata harvesting experience for data producers. One of the new additions is the adoption of the Apache Solr. Solr is an open-source search platform built on top of the Lucene search library and is used by many commercial enterprises worldwide. Solr is a key component in our new harvesting infrastructure. Populating a Solr search index is relatively straightforward. Ingestion requires posting a document containing a series of key-value pairs representing the metadata of a dataset into a RESTful style interface. Although not immediately evident, this provides a valid solution to the transformation problem stated above. We are now able to construct a robust harvesting framework for transforming multiple data formats into the format Solr expects for ingestion. Let us refer to Figure 6, which gives an abstract view of the new harvesting environment. Metadata is fed to the metadata handlers, which manage how metadata can be parsed from its corresponding standard s structure. When the information is extracted, it is transformed into that key-value pair configuration that Solr expects. Only a trivial POST to Solr s HTTP interface is then required to fully ingest a metadata document. The new ESG harvester currently supports a wide variety of formats that are commonly utilized by climate modellers and observational scientists alike. These formats include popular metadata structures, including THREDDS, OAI, CAS RDF, and FGDC. One of the greatest features of the new framework, however, is that it is fully extensible. Metadata handlers are essentially written as plugins to the harvesting framework (see Figure 6). Developers can design external modules that parse new metadata formats and plug it in to the existing architecture with relative ease. B. Addressing ESG Data Consumer Requirements: Usability In Section III-C, we presented a design that accommodated the data producer s requirements for metadata diversity support. The harvester framework provided data producers a simple way to be indexed and prepared for discovery in the ESG framework. Potential consumers of that data, however, are often concerned with the manner in which this harvested metadata is presented. Specifically, they are concerned with the usability of the harvested data s interface (i.e. the in the context of the ESG framework). An oft-studied concept, usability requires careful consideration in designing interfaces
6 that are learnable, intuitive, and easy-to-use. To promote usability, we have altered the current scheme and believe that we have been able to improve ESG web usability by addressing two very relevant issues for current and future ESG data consumers. To satisfy these requirements, we have added new components on the web front end that promote a comfortable search environment for a greater umbrella of users. Features like search box auto-completion and current search constraint listings aid in user comprehension. Our faceted-based category navigation tools have expanded to include terms that are nonbiased. Moreover, we have built new geospatial and temporal range search tools, illustrated in Figures 7. We also wanted to design a search environment that leverages the recent advances in web technology to promote efficiency. In this scheme, we create a single, intuitive search page, illustrated in Figure 7, that heavily utilizes the emerging ajax-style functionality. Data consumers need only visit one composite page where they pick and choose the component they would like to use to aid in their dataset search. Search components are encased in overlays, while search state is presented to the user in a clear and concise manner. This configuration has several inherent advantages. The overhead of the clumsy back and forth static page navigation is eliminated. Specific search constraints can be easily identified during the search process. Finally, consumers can add search requirements in parallel. For example, the user can perform a geospatial range search while simultaneously view facet values that are associated with that region, as Figure 7 illustrates. Faceted Search Autocomplete Text Search Geospatial Search Temporal Search Fig. 7. Snapshot of Single Page View of the ESG Search Portal and components. To summarize, our new search and index infrastructure has been designed to simplify both data producers and consumers interactions with the ESG system. Data producers now have a viable tool to publish metadata in their own customized formats to ESG, enhancing their discoverability. Data consumers may now navigate the ESG system in a more intuitive manner because of the various improvements in usability. VII. SUMMARY AND FUTURE WORK In this paper, we demonstrated that there are many aspects and intricacies that we must consider when designing data management strategies and solutions for ESG, especially in connection with supporting HPC environment. Specifically, we identified three key functional areas of the ESG data lifecycle deep storage access, data publication, and data search and indexing that particularly require dedicated attention and immediate optimal solutions. These areas all pose unique and interesting challenges that required us to stretch the limits and capabilities of modern HPC technology as well as truly understand how users interact with the ESG system. Moving forward, we would like to consider better integration on leveraging HPC as the data analysis engine, investigate scalable service infrastructure to accommodate both data diversity and data scale, and explore social aspects of such scientific data portal, with goals to make ESG both a platform as well as a truly indispensable tool that aid and support the end-to-end scientific discovery process. REFERENCES [1] ESG: Earth System Grid Project. Accessed May 20, [2] CMIP5: Coupled Model Intercomparison Project Phase 5. cmip-pcmdi.llnl.gov/cmip5/, Accessed May 25, [3] CMIP5 requested parameters. standard output.pdf, Accessed On May, [4] William Allcock, John Bresnahan, Rajkumar Kettimuthu, Michael Link, Catalin Dumitrescu, Ioan Raicu, and Ian Foster. The globus striped gridftp framework and server. SC Conference, 0:54, [5] A.S. Bland, R.A. Kendall, D.B. Kothe, J.H. Rogers, and G.M. Shipman. Jaguar: The world s most powerful computer. Memory (TB), 300(62):362. [6] Ann Louise Chervenak. Tertiary storage: an evaluation of new applications. PhD thesis, University of California at Berkeley Berkeley, CA, USA, [7] Ben Domenico, John Caron, Ethan Davis, Robb Kambic, and Stefano Nativi. Thematic real-time environmental distributed data services (thredds): Incorporating interactive analysis tools into nsdl. Journal of Digital Information, 2, [8] Brian Eaton, Jonathan Gregory, Bob Drach, Karl Taylor, Steve Hankin, John Caron, Rich Signell, Phil Bentley, and Greg Rappa. Netcdf climate and forecast (cf) metadata conventions (version 1.4). gov/documents/cf-conventions/1.4/cf-conventions.html, Feburary [9] Ian Foster. Globus Online: Accelerating and Democratizing Science through Cloud-Based Services. Internet Computing, IEEE, 15(3):70 73, may-june [10] G. Shipman, D. Dillow, S. Oral, and F. Wang. The spider center wide file system: From concept to reality. In Proceedings, Cray User Group (CUG) Conference, Atlanta, GA, [11] A. Shoshani, A. Sim, and J. Gu. Storage resource managers. International Series in Operations Research and Management Science, pages , [12] Alex Sim, Mehmet Balman, Dean Williams, Arie Shoshani, and Vijaya Natarajan. Adaptive transfer adjustment in efficient bulk data transfer management for climate dataset. In Parallel and Distributed Computing and Systems, [13] Karl E. Taylor, V. Balaji, Steve Hankin, Martin Juckes, Bryan Lawrence, and Stephen Pascoe. CMIP5 Data Reference Syntax (DRS) and Controlled Vocabulary, Version docs/cmip5 data reference syntax.pdf, March [14] Karl E. Taylor, Ronald J. Stouffer, and Gerald A. Meehl. A Summary of the CMIP5 Experiment Design. Taylor CMIP5 design.pdf, January [15] Feiyi Wang, Sarp Oral, Galen Shipman, Oleg Drokin, Tom Wang, and Isaac Huang. Understanding Lustre Filesystem Internals. Technical Report ORNL/TM-2009/117, ORNL, 2009.
Exploration of adaptive network transfer for 100 Gbps networks Climate100: Scaling the Earth System Grid to 100Gbps Network
Exploration of adaptive network transfer for 100 Gbps networks Climate100: Scaling the Earth System Grid to 100Gbps Network February 1, 2012 Project period of April 1, 2011 through December 31, 2011 PrincipalMore information
How To Build An Elastic Distributed System Over Big Data. http://esgf.org
How To Build An Elastic Distributed System Over Big Data Overview! The Earth System Grid Federation (ESGF.org) is indeed a spontaneous, unfunded, community-driven, open-source, collaborative effort toMore information
GridFTP: A Data Transfer Protocol for the Grid
GridFTP: A Data Transfer Protocol for the Grid Grid Forum Data Working Group on GridFTP Bill Allcock, Lee Liming, Steven Tuecke ANL Ann Chervenak USC/ISI Introduction In Grid environments,More information
The Data Grid: Towards an Architecture for Distributed Management and Analysis of Large Scientific Datasets
The Data Grid: Towards an Architecture for Distributed Management and Analysis of Large Scientific Datasets!! Large data collections appear in many scientific domains like climate studies.!! Users andMore information
Wrangler: A New Generation of Data-intensive Supercomputing. Christopher Jordan, Siva Kulasekaran, Niall Gaffney
Wrangler: A New Generation of Data-intensive Supercomputing Christopher Jordan, Siva Kulasekaran, Niall Gaffney Project Partners Academic partners: TACC Primary system design, deployment, and operationsMore information
ADAPTIVE TRANSFER ADJUSTMENT IN EFFICIENT BULK DATA TRANSFER MANAGEMENT FOR CLIMATE DATASET Alex Sim1, Mehmet Balman1, Dean Williams2, Arie Shoshani1, Vijaya Natarajan1 Lawrence Berkeley National Laboratory,More information
Large File System Backup NERSC Global File System Experience
Large File System Backup NERSC Global File System Experience M. Andrews, J. Hick, W. Kramer, A. Mokhtarani National Energy Research Scientific Computing Center at Lawrence Berkeley National LaboratoryMore information
European Data Infrastructure - EUDAT Data Services & Tools
European Data Infrastructure - EUDAT Data Services & Tools Dr. Ing. Morris Riedel Research Group Leader, Juelich Supercomputing Centre Adjunct Associated Professor, University of iceland BDEC2015, 2015-01-28More information
Storage Resource Managers: Middleware Components for Grid Storage
Storage Resource Managers: Middleware Components for Grid Storage Arie Shoshani, Alex Sim, Junmin Gu Lawrence Berkeley National Laboratory Berkeley, California 94720 {shoshani, asim, email@example.com tel +1-510-486-5171More information
Data Management in an International Data Grid Project. Timur Chabuk 04/09/2007
Data Management in an International Data Grid Project Timur Chabuk 04/09/2007 Intro LHC opened in 2005 several Petabytes of data per year data created at CERN distributed to Regional Centers all over theMore information
The Ultra-scale Visualization Climate Data Analysis Tools (UV-CDAT): A Vision for Large-Scale Climate Data
The Ultra-scale Visualization Climate Data Analysis Tools (UV-CDAT): A Vision for Large-Scale Climate Data Lawrence Livermore National Laboratory? Hank Childs (LBNL) and Charles Doutriaux (LLNL) SeptemberMore information
CMIP6 Data Management at DKRZ
CMIP6 Data Management at DKRZ icas2015 Annecy, France on 13 17 September 2015 Michael Lautenschlager Deutsches Klimarechenzentrum (DKRZ) With contributions from ESGF Executive Committee and WGCM InfrastructureMore information
A Survey Study on Monitoring Service for Grid
A Survey Study on Monitoring Service for Grid Erkang You firstname.lastname@example.com ABSTRACT Grid is a distributed system that integrates heterogeneous systems into a single transparent computer, aiming to provideMore information
13.2 THE INTEGRATED DATA VIEWER A WEB-ENABLED APPLICATION FOR SCIENTIFIC ANALYSIS AND VISUALIZATION Don Murray*, Jeff McWhirter, Stuart Wier, Steve Emmerson Unidata Program Center, Boulder, Colorado 1.More information
DataMover: Robust Terabyte-Scale Multi-file Replication over Wide-Area Networks
DataMover: Robust Terabyte-Scale Multi-file Replication over Wide-Area Networks Alex Sim, Junmin Gu, Arie Shoshani, Vijaya Natarajan Lawrence Berkeley National Laboratory (asim, jgu, shoshani, vnatarajan)@lbl.govMore information
NASA's Strategy and Activities in Server Side Analytics
NASA's Strategy and Activities in Server Side Analytics Tsengdar Lee, Ph.D. High-end Computing Program Manager NASA Headquarters Presented at the ESGF/UVCDAT Conference Lawrence Livermore National LaboratoryMore information
Monitoring Tools for Large Scale Systems
Monitoring Tools for Large Scale Systems Ross Miller, Jason Hill, David A. Dillow, Raghul Gunasekaran, Galen Shipman, Don Maxwell Oak Ridge Leadership Computing Facility, Oak Ridge National LaboratoryMore information
Insights from 40 years of data services at NCAR s Research Data Archive. Douglas Schuster and Steven Worley
Insights from 40 years of data services at NCAR s Research Archive Douglas Schuster (email@example.com) and Steven Worley (firstname.lastname@example.com) Highlights What is the? Evolution of Services User RegistrationMore information
Cisco and EMC Solutions for Application Acceleration and Branch Office Infrastructure Consolidation
Solution Overview Cisco and EMC Solutions for Application Acceleration and Branch Office Infrastructure Consolidation IT organizations face challenges in consolidating costly and difficult-to-manage branch-officeMore information
High Performance Storage System. Overview
Overview * Please review disclosure statement on last slide Please see disclaimer on last slide Copyright IBM 2009 Slide Number 1 Hierarchical storage software developed in collaboration with five US DepartmentMore information
Big Data Services at DKRZ
Big Data Services at DKRZ Michael Lautenschlager and Colleagues from DKRZ and Scientific Computing Research Group MPI-M Seminar Hamburg, March 31st, 2015 Big Data in Climate Research Big data is an all-encompassingMore information
The THREDDS Data Repository: for Long Term Data Storage and Access
8B.7 The THREDDS Data Repository: for Long Term Data Storage and Access Anne Wilson, Thomas Baltzer, John Caron Unidata Program Center, UCAR, Boulder, CO 1 INTRODUCTION In order to better manage ever increasingMore information
Amazon Cloud Storage Options
Amazon Cloud Storage Options Table of Contents 1. Overview of AWS Storage Options 02 2. Why you should use the AWS Storage 02 3. How to get Data into the AWS.03 4. Types of AWS Storage Options.03 5. ObjectMore information
www.thinkparq.com www.beegfs.com
www.thinkparq.com www.beegfs.com KEY ASPECTS Maximum Flexibility Maximum Scalability BeeGFS supports a wide range of Linux distributions such as RHEL/Fedora, SLES/OpenSuse or Debian/Ubuntu as well as aMore information
With DDN Big Data Storage
DDN Solution Brief Accelerate > ISR With DDN Big Data Storage The Way to Capture and Analyze the Growing Amount of Data Created by New Technologies 2012 DataDirect Networks. All Rights Reserved. The BigMore information
Introduction to NetApp Infinite Volume
Technical Report Introduction to NetApp Infinite Volume Sandra Moulton, Reena Gupta, NetApp April 2013 TR-4037 Summary This document provides an overview of NetApp Infinite Volume, a new innovation inMore information
Parallel Analysis and Visualization on Cray Compute Node Linux
Parallel Analysis and Visualization on Cray Compute Node Linux David Pugmire, Oak Ridge National Laboratory and Hank Childs, Lawrence Livermore National Laboratory and Sean Ahern, Oak Ridge National LaboratoryMore information
The ORIENTGATE data platform
Seminar on Proposed and Revised set of indicators June 4-5, 2014 - Belgrade (Serbia) The ORIENTGATE data platform WP2, Action 2.4 Alessandra Nuzzo, Sandro Fiore, Giovanni Aloisio Scientific Computing andMore information
Diagram 1: Islands of storage across a digital broadcast workflow
XOR MEDIA CLOUD AQUA Big Data and Traditional Storage The era of big data imposes new challenges on the storage technology industry. As companies accumulate massive amounts of data from video, sound, database,More information
Data Requirements from NERSC Requirements Reviews
Data Requirements from NERSC Requirements Reviews Richard Gerber and Katherine Yelick Lawrence Berkeley National Laboratory Summary Department of Energy Scientists represented by the NERSC user communityMore information
Taking Big Data to the Cloud. Enabling cloud computing & storage for big data applications with on-demand, high-speed transport WHITE PAPER
Taking Big Data to the Cloud WHITE PAPER TABLE OF CONTENTS Introduction 2 The Cloud Promise 3 The Big Data Challenge 3 Aspera Solution 4 Delivering on the Promise 4 HIGHLIGHTS Challenges Transporting largeMore information
Chapter 7. Using Hadoop Cluster and MapReduce
Chapter 7 Using Hadoop Cluster and MapReduce Modeling and Prototyping of RMS for QoS Oriented Grid Page 152 7. Using Hadoop Cluster and MapReduce for Big Data Problems The size of the databases used inMore information
PIT adoption for Climate Data Management
PIT adoption for Climate Management The German Climate Computing Center (DKRZ) 5th RDA Plenary Stephan Kindermann Overview DKRZ: A climate science service provider services for the international climateMore information
Information management software solutions White paper. Powerful data warehousing performance with IBM Red Brick Warehouse
Information management software solutions White paper Powerful data warehousing performance with IBM Red Brick Warehouse April 2004 Page 1 Contents 1 Data warehousing for the masses 2 Single step loadMore information
EMC NETWORKER AND DATADOMAIN Capabilities, options and news Madis Pärn Senior Technology Consultant EMC email@example.com 1 IT Pressures 2009 0.8 Zettabytes 2020 35.2 Zettabytes DATA DELUGE BUDGET DILEMMAMore information
THE CCLRC DATA PORTAL Glen Drinkwater, Shoaib Sufi CCLRC Daresbury Laboratory, Daresbury, Warrington, Cheshire, WA4 4AD, UK. E-mail: firstname.lastname@example.com, email@example.com Abstract: The project aimsMore information
Data Management and Analysis in Support of DOE Climate Science
Data Management and Analysis in Support of DOE Climate Science August 7 th, 2013 Dean Williams, Galen Shipman Presented to: Processing and Analysis of Very Large Data Sets Workshop The Climate Data ChallengeMore information
GridFTP GUI: An Easy and Efficient Way to Transfer Data in Grid
GridFTP GUI: An Easy and Efficient Way to Transfer Data in Grid Wantao Liu 1,2 Raj Kettimuthu 2,3, Brian Tieman 3, Ravi Madduri 2,3, Bo Li 1, and Ian Foster 2,3 1 Beihang University, Beijing, China 2 TheMore information
Concepts and Architecture of Grid Computing. Advanced Topics Spring 2008 Prof. Robert van Engelen
Concepts and Architecture of Grid Computing Advanced Topics Spring 2008 Prof. Robert van Engelen Overview Grid users: who are they? Concept of the Grid Challenges for the Grid Evolution of Grid systemsMore information
The Ultimate in Scale-Out Storage for HPC and Big Data
Node Inventory Health and Active Filesystem Throughput Monitoring Asset Utilization and Capacity Statistics Manager brings to life powerful, intuitive, context-aware real-time monitoring and proactiveMore information
Workload Characterization and Analysis of Storage and Bandwidth Needs of LEAD Workspace
Workload Characterization and Analysis of Storage and Bandwidth Needs of LEAD Workspace Beth Plale Indiana University email@example.com LEAD TR 001, V3.0 V3.0 dated January 24, 2007 V2.0 dated AugustMore information
Implementing Network Attached Storage. Ken Fallon Bill Bullers Impactdata
Implementing Network Attached Storage Ken Fallon Bill Bullers Impactdata Abstract The Network Peripheral Adapter (NPA) is an intelligent controller and optimized file server that enables network-attachedMore information
Utilizing the SDSC Cloud Storage Service
Utilizing the SDSC Cloud Storage Service PASIG Conference January 13, 2012 Richard L. Moore firstname.lastname@example.com San Diego Supercomputer Center University of California San Diego Traditional supercomputer centerMore information
T E C H N O L O G Y B R I E F. Archiving Beyond File Systems: Object Storage EMC Centera And Disk Archival
Archiving Beyond File Systems: Object Storage EMC Centera And Disk Archival January 2009 Disk-based archiving answers many challenges in an organization, but this strong trend also creates questions forMore information
Deploying a distributed data storage system on the UK National Grid Service using federated SRB
Deploying a distributed data storage system on the UK National Grid Service using federated SRB Manandhar A.S., Kleese K., Berrisford P., Brown G.D. CCLRC e-science Center Abstract As Grid enabled applicationsMore information
How to Enhance Traditional BI Architecture to Leverage Big Data
B I G D ATA How to Enhance Traditional BI Architecture to Leverage Big Data Contents Executive Summary... 1 Traditional BI - DataStack 2.0 Architecture... 2 Benefits of Traditional BI - DataStack 2.0...More information
Big data management with IBM General Parallel File System
Big data management with IBM General Parallel File System Optimize storage management and boost your return on investment Highlights Handles the explosive growth of structured and unstructured data OffersMore information
Scala Storage Scale-Out Clustered Storage White Paper
White Paper Scala Storage Scale-Out Clustered Storage White Paper Chapter 1 Introduction... 3 Capacity - Explosive Growth of Unstructured Data... 3 Performance - Cluster Computing... 3 Chapter 2 CurrentMore information
Technical. Overview. ~ a ~ irods version 4.x
Technical Overview ~ a ~ irods version 4.x The integrated Ru e-oriented DATA System irods is open-source, data management software that lets users: access, manage, and share data across any type or numberMore information
Flattening Enterprise Knowledge
Flattening Enterprise Knowledge Do you Control Your Content or Does Your Content Control You? 1 Executive Summary: Enterprise Content Management (ECM) is a common buzz term and every IT manager knows itMore information
Four Ways High-Speed Data Transfer Can Transform Oil and Gas WHITE PAPER
Transform Oil and Gas WHITE PAPER TABLE OF CONTENTS Overview Four Ways to Accelerate the Acquisition of Remote Sensing Data Maximize HPC Utilization Simplify and Optimize Data Distribution Improve BusinessMore information
Integrating Data Life Cycle into Mission Life Cycle. Arcot Rajasekar email@example.com firstname.lastname@example.com
Integrating Data Life Cycle into Mission Life Cycle Arcot Rajasekar firstname.lastname@example.com firstname.lastname@example.com 1 Technology of Interest Provide an end-to-end capability for Exa-scale data orchestration FromMore information
NOAA Environmental Data Management Update for Unidata SAC 2014-10-08
NOAA Environmental Management Update for Unidata SAC 2014-10-08 Jeff de La Beaujardière, PhD NOAA Management Architect +1 301-713-7175 NOAA data are unique, valuable, and irreplaceable Many observing systems:More information
Designing a Cloud Storage System
Designing a Cloud Storage System End to End Cloud Storage When designing a cloud storage system, there is value in decoupling the system s archival capacity (its ability to persistently store large volumesMore information
A Web Services Data Analysis Grid *
A Web Services Data Analysis Grid * William A. Watson III, Ian Bird, Jie Chen, Bryan Hess, Andy Kowalski, Ying Chen Thomas Jefferson National Accelerator Facility 12000 Jefferson Av, Newport News, VA 23606,More information
Big Data and the Earth Observation and Climate Modelling Communities: JASMIN and CEMS
Big Data and the Earth Observation and Climate Modelling Communities: JASMIN and CEMS Workshop on the Future of Big Data Management 27-28 June 2013 Philip Kershaw Centre for Environmental Data ArchivalMore information
Next-Generation Networking for Science
Next-Generation Networking for Science ASCAC Presentation March 23, 2011 Program Managers Richard Carlson Thomas Ndousse PresentationMore information
MIGRATING DESKTOP AND ROAMING ACCESS. Migrating Desktop and Roaming Access Whitepaper
Migrating Desktop and Roaming Access Whitepaper Poznan Supercomputing and Networking Center Noskowskiego 12/14 61-704 Poznan, POLAND 2004, April white-paper-md-ras.doc 1/11 1 Product overview In this whitepaperMore information
Make the Most of Big Data to Drive Innovation Through Reseach
White Paper Make the Most of Big Data to Drive Innovation Through Reseach Bob Burwell, NetApp November 2012 WP-7172 Abstract Monumental data growth is a fact of life in research universities. The abilityMore information
MarkLogic Enterprise Data Layer
MarkLogic Enterprise Data Layer MarkLogic Enterprise Data Layer MarkLogic Enterprise Data Layer September 2011 September 2011 September 2011 Table of Contents Executive Summary... 3 An Enterprise DataMore information
SciDAC Petascale Data Storage Institute
SciDAC Petascale Data Storage Institute Advanced Scientific Computing Advisory Committee Meeting October 29 2008, Gaithersburg MD Garth Gibson Carnegie Mellon University and Panasas Inc. SciDAC PetascaleMore information
Data Grids. Lidan Wang April 5, 2007
Data Grids Lidan Wang April 5, 2007 Outline Data-intensive applications Challenges in data access, integration and management in Grid setting Grid services for these data-intensive application ArchitecturalMore information
Integrating VoltDB with Hadoop
The NewSQL database you ll never outgrow Integrating with Hadoop Hadoop is an open source framework for managing and manipulating massive volumes of data. is an database for handling high velocity data.More information
Information Sciences Institute University of Southern California Los Angeles, CA 90292 {annc, email@example.com
_ Secure, Efficient Data Transport and Replica Management for High-Performance Data-Intensive Computing Bill Allcock 1 Joe Bester 1 John Bresnahan 1 Ann L. Chervenak 2 Ian Foster 1,3 Carl Kesselman 2 SamMore information
IBM Global Technology Services November 2009. Successfully implementing a private storage cloud to help reduce total cost of ownership
IBM Global Technology Services November 2009 Successfully implementing a private storage cloud to help reduce total cost of ownership Page 2 Contents 2 Executive summary 3 What is a storage cloud? 3 AMore information
W H I T E P A P E R. Deriving Intelligence from Large Data Using Hadoop and Applying Analytics. Abstract
W H I T E P A P E R Deriving Intelligence from Large Data Using Hadoop and Applying Analytics Abstract This white paper is focused on discussing the challenges facing large scale data processing and theMore information
EMC SYNCPLICITY FILE SYNC AND SHARE SOLUTION Automated file synchronization Flexible, cloud-based administration Secure, on-premises storage EMC Solutions January 2015 Copyright 2014 EMC Corporation. AllMore information
Analisi di un servizio SRM: StoRM
27 November 2007 General Parallel File System (GPFS) The StoRM service Deployment configuration Authorization and ACLs Conclusions. Definition of terms Definition of terms 1/2 Distributed File System TheMore information
Middleware support for the Internet of Things
Middleware support for the Internet of Things Karl Aberer, Manfred Hauswirth, Ali Salehi School of Computer and Communication Sciences Ecole Polytechnique Fédérale de Lausanne (EPFL) CH-1015 Lausanne,More information
Session: What to do with the data?
Session: What to do with the data? Proceedings Paper Prepared for: Business s Management Association 2006 Symposium Presented By Microsoft & Avanade Session 43 Proceedings Paper 2 Introduction For severalMore information
Elements of Scalable Data Analysis and Visualization
Elements of Scalable Data Analysis and Visualization www.ultravis.org DOE CGF Petascale Computing Session Tom Peterka firstname.lastname@example.com Mathematics and Computer Science Division 0. Preface - ScienceMore information
How In-Memory Data Grids Can Analyze Fast-Changing Data in Real Time
SCALEOUT SOFTWARE How In-Memory Data Grids Can Analyze Fast-Changing Data in Real Time by Dr. William Bain and Dr. Mikhail Sobolev, ScaleOut Software, Inc. 2012 ScaleOut Software, Inc. 12/27/2012 T wenty-firstMore information
Archive Data Retention & Compliance. Solutions Integrated Storage Appliances. Management Optimized Storage & Migration
Solutions Integrated Storage Appliances Management Optimized Storage & Migration Archive Data Retention & Compliance Services Global Installation & Support SECURING THE FUTURE OF YOUR DATA w w w.q staMore information
Archival Data Format Requirements
Archival Data Format Requirements July 2004 The Royal Library, Copenhagen, Denmark The State and University Library, Århus, Denmark Main author: Steen S. Christensen The Royal Library Postbox 2149 1016More information
System Requirement Specification for A Distributed Desktop Search and Document Sharing Tool for Local Area Networks
System Requirement Specification for A Distributed Desktop Search and Document Sharing Tool for Local Area Networks OnurSoft Onur Tolga Şehitoğlu November 10, 2012 v1.0 Contents 1 Introduction 3 1.1 Purpose..............................More information
September 2009 Cloud Storage for Cloud Computing
September 2009 Cloud Storage for Cloud Computing This paper is a joint production of the Storage Networking Industry Association and the Open Grid Forum. Copyright 2009 Open Grid Forum, Copyright 2009More information
Data Centric Systems (DCS)
Data Centric Systems (DCS) Architecture and Solutions for High Performance Computing, Big Data and High Performance Analytics High Performance Computing with Data Centric Systems 1 Data Centric SystemsMore information
BaBar and ROOT data storage. Peter Elmer BaBar Princeton University ROOT2002 14 Oct. 2002
BaBar and ROOT data storage Peter Elmer BaBar Princeton University ROOT2002 14 Oct. 2002 The BaBar experiment BaBar is an experiment built primarily to study B physics at an asymmetric high luminosityMore information
BlueArc unified network storage systems 7th TF-Storage Meeting. Scale Bigger, Store Smarter, Accelerate Everything
BlueArc unified network storage systems 7th TF-Storage Meeting Scale Bigger, Store Smarter, Accelerate Everything BlueArc s Heritage Private Company, founded in 1998 Headquarters in San Jose, CA HighestMore information
globus online Cloud-based services for (reproducible) science Ian Foster Computation Institute University of Chicago and Argonne National Laboratory
globus online Cloud-based services for (reproducible) science Ian Foster Computation Institute University of Chicago and Argonne National Laboratory Computation Institute (CI) Apply to challenging problemsMore information
HPC & Visualization. Visualization and High-Performance Computing
HPC & Visualization Visualization and High-Performance Computing Visualization is a critical step in gaining in-depth insight into research problems, empowering understanding that is not possible withMore information
EMC s Enterprise Hadoop Solution. By Julie Lockner, Senior Analyst, and Terri McClure, Senior Analyst
White Paper EMC s Enterprise Hadoop Solution Isilon Scale-out NAS and Greenplum HD By Julie Lockner, Senior Analyst, and Terri McClure, Senior Analyst February 2012 This ESG White Paper was commissionedMore information
Optimizing Mass Storage Organization and Access for Multi-Dimensional Scientific Data
Optimizing Mass Storage Organization and Access for Multi-Dimensional Scientific Data Robert Drach, Susan W. Hyer, Steven Louis, Gerald Potter, George Richmond Lawrence Livermore National Laboratory Livermore,More information
Web Service Robust GridFTP
Web Service Robust GridFTP Sang Lim, Geoffrey Fox, Shrideep Pallickara and Marlon Pierce Community Grid Labs, Indiana University 501 N. Morton St. Suite 224 Bloomington, IN 47404 {sblim, gcf, spallick,More information
Open Problems in Network-aware Data Management in Exa-scale Computing and Terabit Networking Era
Open Problems in Network-aware Data Management in Exa-scale Computing and Terabit Networking Era Mehmet Balman Lawrence Berkeley National Laboratory Berkeley, CA, USA firstname.lastname@example.com Surendra Byna LawrenceMore information
Big Data Challenges In Leadership Computing
Big Data Challenges In Leadership Computing Presented to: Data Direct Network s SC 2011 Technical Lunch November 14, 2011 Galen Shipman Technology Integration Group Leader Office of Science Computing atMore information
REACCH PNA Data Management Plan
REACCH PNA Data Management Plan Regional Approaches to Climate Change (REACCH) For Pacific Northwest Agriculture 875 Perimeter Drive MS 2339 Moscow, ID 83844-2339 http://www.reacchpna.org email@example.com information
Integration strategy
C3-INAD and ESGF: Integration strategy C3-INAD Middleware Team: Stephan Kindermann, Carsten Ehbrecht [DKRZ] Bernadette Fritzsch [AWI] Maik Jorra, Florian Schintke, Stefan Plantikov [ZUSE Institute] MarkusMore information
Adobe Anywhere for video Collaborate without boundaries
Introducing Adobe Anywhere for video Collaborate without boundaries As a professional video producer, you face a growing demand for more content on a widening variety of devices and platforms. Today sMore information
MAGENTO HOSTING Progressive Server Performance Improvements
MAGENTO HOSTING Progressive Server Performance Improvements Simple Helix, LLC 4092 Memorial Parkway Ste 202 Huntsville, AL 35802 email@example.com 1.866.963.0424 www.simplehelix.com 2 Table of ContentsMore information
SURFsara Data Services
SURFsara Data Services SUPPORTING DATA-INTENSIVE SCIENCES Mark van de Sanden The world of the many Many different users (well organised (international) user communities, research groups, universities,More information
InfiniteGraph: The Distributed Graph Database
A Performance and Distributed Performance Benchmark of InfiniteGraph and a Leading Open Source Graph Database Using Synthetic Data Objectivity, Inc. 640 West California Ave. Suite 240 Sunnyvale, CA 94086More information
EMC ISILON OneFS OPERATING SYSTEM Powering scale-out storage for the new world of Big Data in the enterprise
EMC ISILON OneFS OPERATING SYSTEM Powering scale-out storage for the new world of Big Data in the enterprise ESSENTIALS Easy-to-use, single volume, single file system architecture Highly scalable withMore information
Easier - Faster - Better
Highest reliability, availability and serviceability ClusterStor gets you productive fast with robust professional service offerings available as part of solution delivery, including quality controlledMore information
Metadata Hierarchy in Integrated Geoscientific Database for Regional Mineral Prospecting
Metadata Hierarchy in Integrated Geoscientific Database for Regional Mineral Prospecting MA Xiaogang WANG Xinqing WU Chonglong JU Feng ABSTRACT: One of the core developments in geomathematics in now daysMore information
Data Movement in Distributed Science Environments. Raj Kettimuthu Argonne National Laboratory and The University of Chicago
Data Movement in Distributed Science Environments Raj Kettimuthu Argonne National Laboratory and The University of Chicago Outline Science Environments Data movement problem GridFTP New features ChallengesMore information
Enhancing the Earth System Grid Security Infrastructure through Single Sign-On and Autoprovisioning
Enhancing the Earth System Grid Security Infrastructure through Single Sign-On and Autoprovisioning F. Siebenlist Argonne National Laboratory Argonne, IL, USA email@example.com R. Ananthakrishnan ArgonneMore information
1. Comments on reviews a. Need to avoid just summarizing web page asks you for:
1. Comments on reviews a. Need to avoid just summarizing web page asks you for: i. A one or two sentence summary of the paper ii. A description of the problem they were trying to solve iii. A summary ofMore information
Archival Storage At LANL Past, Present and Future
Archival Storage At LANL Past, Present and Future Danny Cook Los Alamos National Laboratory email@example.com Salishan Conference on High Performance Computing April 24-27 2006 LA-UR-06-0977 Main points ofMore information


text:
Slick, slim and comfortable in the hand, the phone is only let down by a slightly plasticky back cover
Resistive touch-screens never offer the same accessibility as capacitive and the size of the display doesn't help here. The trackpad and keyboard are both good though
The near-latest version of Android is welcome, as is access to the many apps in the Android Market. But some just won't work that well on the small screen
Although the processor is slow in comparison to most smartphones, lag was minimal
That smaller screen has the advantage of not draining the battery as much as a bigger one, so battery life is decent: it'll easily last you a full day without you fretting
Review by Sunetra Chakravati,12/12/2011 4:01:06 PM
Look and feel
Ease of use
Battery life
Great keyboard, decent battery life
Small, resistive touch-screen leaves a lot to be desired
The Acer beTouch E210 is the company's latest phone to feature both a touch-screen and a QWERTY keyboard. The BlackBerry Torch has both these features, but that's a big, expensive handset while this is much smaller, lighter and cheaper.What's more, it's an Android phone, so there are over 300,000 apps you can quickly and easily download, where BlackBerry has far fewer, and generally pricier apps to choose from. This phone comes with Android 2.2 aka Froyo, which isn't quite the latest but has most of the features you'd want. Android's apps include a good push email function, though BlackBerry is still the email gold standard for speed, reliability and security.
When you wake the handset you have to swipe your finger across the screen to unlock it. Note that, as this is a resistive touch-screen, rather than the capacitive kind found on pricier smartphones, the display here is pressure-sensitive. It took me several tries to unlock the screen and was particularly tricky if using one hand to both hold the handset and swipe the screen.That's the annoying thing about resistive touch-screens – that and the lower resolution usually found on such displays. Mind you, this one is reasonably responsive, when you get into the habit of pressing with a little more force than will seem natural if you're more used to an iPhone. And at least you can poke at this screen with a stylus or use it through gloves if you want to. Like Acer's earlier QWERTY phones, the beTouch E210 has a decent keyboard. There's no space between them, which often signals disaster, but each is domed so it's easy to hit the one you want. It's still not as good as the best on the market (i.e. BlackBerry again) but highly usable.
The silver keys and base of the phone look snazzy enough, though they work better in bright light: the backlighting can make the keys hard to read. The same silver shade is used for the back cover, too, and here it looks less persuasive, a little plasticky, in fact. The best-looking part of the back is the camera lens and loudspeaker grille that sit at the top. The grille means there's no place for a flash, which is a shame, and the 3.2-megapixel resolution isn't going to make this a substitute camera for any but the most basic shots. There's a highly usable trackpad underneath the screen – a step up from the trackball of earlier Acer QWERTY handsets. This is surrounded by four physical Android buttons (home, menu, back and search) and flanked by physical call, send and end buttons. All very good, except the problem with all this inputting action, from keys to trackpad to phone buttons, is that there's precious little space left for a screen. As a result, the 2.6-inch display seems cramped – placing virtual Android buttons on-screen may have been better use of space if it afforded a bigger screen.
As it is, the display is too small to make gaming easy, and surfing the internet when you're used to a smartphone screen that's 3.5-inches or more gets old quickly. This may not be a fatal problem, but it does limit the phone's usability. But the beTouch E210 includes 3G, which some of the more affordable BlackBerry handsets don't, plus the usual smartphone features of GPS, compass and Wi-Fi. Though that small screen also means you won't be using it as a replacement for your TomTom, either. When it comes to typing, the phone excels, with word prediction suggestions floating across the base of the screen. These work well enough, but when you tap a suggested word it would have been useful if the software knew to add a space too. As an affordable alternative to BlackBerry, the BeTouch E210 has a lot going for it.
Fancy a BlackBerry but want something more affordable, with more apps? The Acer beTouch E210 has a lot to recommend it, and is a good messaging device thanks to its accessible keyboard. But the small screen hobbles it when it comes to gaming, multimedia playback and luxurious web surfing. And the camera is decidedly average. While there's 3G, Wi-Fi and GPS, you may find you tire of the tiddly display and unexceptional processor speed if you want much more than email and texting. So in that case, maybe a BlackBerry is still a better option.

subset: commoncrawl


text:
A NEW group set up to promote tourism in and around Chippping Campden has already proved a hit with residents.
More than 30 individuals and business owners met for the Chipping Campden Experience's inaugural meeting at Hidcote Manor Garden. The group was formed to discuss ways to help promote the town and outlying villages as a tourist destination.
The next meeting, which is open to anyone who has an interest in tourism in the town, is being held on Tuesday, December 4. For details, call Julian Ebbutt on 01386 700286 or e-mail email@example.com


text:
Met Art presents a fascinating collection of the most beautiful nude girls and their erotic pictures in the world. Tube Porn. You will not find filth or dirty sexual games at Met Art, but only beauty of a perfectly shaped teen body. These girls will still let you enjoy their bodies in every detail, but they will do in the special style peculiar to Met Art only.
WoW! VERY HOT GIRL!!!... Love to see her getting Fucked in her Pussy and ASS and CUM running out of her Pussy taking a creampie.


text:
Professor: American killed in Ethiopia had bright future
An American researcher killed in a rock attack by protesters in Ethiopia this week was a talented scientist with a bright future, the chairman of her department at the University of California, Davis said Thursday.
Sharon Gray, 30, was a leader in the study of how climate change affects plants, said Savithramma Dinesh-Kumar, chair of the plant biology department at UC Davis.
"She's really an always-smiling slip of sunshine. She's a smart, energetic scientist," Dinesh-Kumar said. "She had a very bright future ahead of her. And everyone knew she was going to be the star in the plant biology department research area."
Gray, a post-doctoral researcher, was in the country for a meeting to kick off a research project when she was killed Tuesday. She was traveling in a car in the outskirts of the capital, Addis Ababa, an area that has seen months of deadly protests.
Gray is the first foreigner killed in the massive protests.


text:
Call our experts: 888.808.FINE
Shop Personalized StationeryCarlson Craft Wedding Invitations Customize any Address Stamp to match your style!
Select a quantity and printing method. Changes are easily made later.
Adhesive address labels save you the time and effort of writing return addresses over and over. This address label features a white background. These address labels are sold on sheets.You may have a maximum of four lines of type and 28 characters per line.


text:
DESIREE ZELLER, Licensed Massage Therapist
"Escape to the Forest for an hour or more of Wellness and Rejuvenation"
Toggle navigation
New to Massage?
Hours & Info
Therapeutic Massage
Spa Massage
Essential Oil Shop
Gentle Yoga
About Desiree
Desiree's Style
Body Sense Magazine
Client Forms
<--------Click on "Essential Oils Shop" Tab for info about my new shop.
<--------Click on "Gentle Yoga" Tab for info on new summer class announcement.
Desiree's lovely wellness studio is located on Cook Forest's scenic River Road. Escape to the forest for an hour or more of wellness and rejuvenation. Desiree is a Licensed Massage Therapist with twelve years of hands on experience in both spa and therapeutic massage settings. She is the
best value in the area
including; weekday affordable
build-your-own massage experience
(including evening hours!),
skillful and experienced
complimentary, pure essential oils
with all services (optional) and high
quality organic massage oils, essential oils and creams
! Desiree is also a professionally trained Yoga Teacher and offers classes in the forest (when able) and Yoga Therapy as an add on after your bodywork session designed for your specific needs (additional cost). For a listing of Desiree's credentials and education, click
. Click on appropriate tab to left for more info.
Studio located on the scenic River Road attached to the Zeller family cottage.
Comfortable, quiet massage room with soothing music of your choice.
Relaxing waiting area with a lovely forest view and complimentary organic tea.
Scenic River Road anytime of the year.
© Copyright 2017 DESIREE ZELLER, Licensed Massage Therapist. All rights reserved.


text:
Couric-BS news is reporting Hillary Clinton's State Department had plenty of warnings that our consulate in Benghazi, Libya was not safe. She knew the consulate was unsafe before the attacks that killed four Americans. Yet, just as we suspected, Hilary Clinton did nothing about it.
Wood told CBS that he repeatedly warned that the consulate was going to be attacked, noting that al Qaeda even posted on a website that it was going to attack the Americans in Benghazi. Clinton has claimed she never saw the reports. That's about as believable as her saying, "This was all because of a video." Then caught with her slacks down (I know, it's gross), she angrily told Conservative American Ron Johnson, "What difference does it make?!"
The Hillary Benghazi cover up was all about getting Obama re-elected.


text:
Lesbian Take Down 3Favorites [+]
Pay-Per-Minute Viewing
You can now enjoy this movie on your iPhone®, iPad®, or compatible Smart TV & Android devices.
Purchase Options
Pay-Per-MinutePurchase Minutes
Streaming Rentals
Available MP4 sizes:SD 480p (0.78 GB)
DRM-free downloads offer content that is not limited by standard Digital Rights Management (DRM) access technologies. These technologies allow hardware manufacturers, publishers, copyright holders and individuals to limit the usage of digital content.
When you purchase DRM-free downloadable content, that content is available for you to download on any computer and save to a disk whenever you like. You can also download to multiple computers. There is no timeframe associated with your purchase and the content will not expire.
Running Time: 50 minutes
Released: 06/2007
Studio Name: Pure Filth Productions Legend
Series: Lesbian Take Down
Description: These sexy lesbians are ready for action! They'll strap it on and strap them down! Don't miss out on the hot lesbian gangbang in "Lesbian Take Down 3"! Enjoy!
2 Scenes from Lesbian Take Down 3
Watch with a Subscription to the SuperPass Channel, with Pay-Per-Minute or Streaming Rental
Lesbian Take Down 3: Scene 1 Free Preview
Sex Acts: Toy Play - Vaginal, Toy Play - Oral, Fisting, Masturbation, Spanking/Paddling, Bondage, Girl on Girl action, Oral Sex, Orgy, Vaginal Sex, Strap-On
Positions: Missionary, Kneeling, Sitting, Laying, Standing
Settings: Living Room
Studio: Pure Filth Productions, Legend
Lesbian Take Down 3: Scene 2 Free Preview
Sex Acts: Toy Play - Vaginal, Toy Play - Oral, Masturbation, Orgy, Spanking/Paddling, Girl on Girl action, Oral Sex
Settings: Living Room
Studio: Pure Filth Productions, Legend
Recommended Movies
AEBN Cams


text:
The place for people who love horses.
35270 County Road 31

We are located on Covell blvd/ Rd 31 between Davis and Winters. 4 miles west of Sutter hospital.

Pine Trails Ranch is a full service horse facility dedicated to working with people of all ages who want to enjoy horses. We offer a lesson program for both kids and adults that can enable riders to learn anything from riding basics to successful competitive skills in both english and western disciplines. We also offer full service boarding and training for your horse from ground work to hunters, dressage, and pleasure horses under saddle. We promote classical and ethical training methods for the health and happiness of your horse. Our over 20 acre facility has multiple arenas, an outdoor hunt field, and extensive facilities that you are welcome to come and see.. Lessons & Boarding,Area's Best Horse Summer Camp,English & Western,Affordable training for all ages
Provided by Yellowpages.com
The place for people who love...
If you've been to or used
Pine Trails Ranch, leave a review.
It's easy, only takes a couple of minutes and you'll help thousands make an informed decision.


text:
NOLWCZ: "intro & overall"
- "The "terms of use" of {this post & its comments, including the privacy & confidentiality of it plus all knowledge obtained from it} is JotHere's standard Terms of Use except:"
- NOKW72: none.
- "SAMPLE": are the same as for the content's earlier source (confidential so far) except as officially specified here in writing.
- "post image" TBA
- "post name history in reverse start-order"
- NOLWE5: now to next: "post template, for http://1.JotHere.com, for use by its author & others, NOLWCZ"
- NOKVCV: now originally to next: "[……]MORE


text:
Adoption requests → Khan Academy Wiki
What is your username? Gregory Heffley
Please link to the wiki here: http://khanacademy.wikia.com/wiki/Khan_Academy_Wiki
How many edits have you made on that wiki? 457
How many days/months have you been editing there? 7 months
On the Special Pages → Special:ListUsers when was the last time an admin edited, and who was it? May 29-TheAmazingNerdino77
Any other information:
I am already an admin but not beaurucrat. The only other user making significant changes recently announced his retirement from the wiki.
- Hi. I'm sorry but the existing bureaucrat answered a message about a month ago and the wiki is not eligible for adoption. If you feel that you need additional admins now I suggest you ask him again; otherwise the wiki will be eligible for adoption at the end of July, and you can ask again at that time. -- Wendy (talk) 01:16, July 2, 2013 (UTC)


text:
Rilynn Rae & Melanie Monroe – Milf And Step-Daughter Threesome
Released: August 24, 2013
Rilynn Rae is chilling with Mellanie Monroe whom is her step-mom. Having a deep conversation bonding with each other.. Come to find out the step-mom is freaky and love men a lot younger and is only with her dad for the money. Mellanie Monroe wanted some dick and Rilynn Rae knew exactly who to call. Somebody with a long fat cock.. Chris came over and fuck the step-mom in her ass-hole and banged Rilynn's tight pussy. Damn! Chris is the man.


text:
Land – for living, Sale, Pezinok, Slovakia
90,00 €/m2
Land – for living, Sale, Modra, Num. ZR-2505
BELLA Real Estate offers for sale a building plot in the beautiful surroundings of the Small Carpathians in the blue part harmony with an area of 1600 m2. IS Network: electricity on the plot, water on the land, gas across the road. The land is slightly sloping with a rectangular shape. Building permission. Access road to the plot is asphalt. When land flowing stream. Ability to get quality water from wells.
City part Modra - is a popular recreational area of the Little Carpathians. Modra city is the cultural center of the region with a rich history and winemaking tradition. Offers throughout the year many social events: vintage, open cellar day, the feast of clay, wine road, traditional sausages Modra, organized tourist events. Right in the city begin hiking and cycling trails of the Small Carpathians, mainly to please lovers of active rest. In winter there are ski and cross-country trails in the city of Modra - Sand, also known as Zochova cottage. The city offers a full range of amenities.
30 min Bratislava
20 min Trnava
5 minutes Recreation Area Zochova Chata
We recommend !!!
Land is also recommended as an excellent investment.
Land price: € 90 / m2
Offer ID: 2505
Contact agent: Petronela Danišková
0902 345 666
Additional offer for www.bellareal.sk
Listing summary
1600 m²
personal property
Real Estate Agency 122 offers
BELLA Real Estate s. r. o.
Viktora Tegelhoffa 3
Bratislava 831 04
+ 421 902 888 666
+ 421 2 20 715 517
Real Estate Agent 5 offers
Petronela Danišková
+421 902 345 666
Your Listing seems interesting, please contact me.
You might also be interested in
111444x Listing appeared in search results
1943x Listing viewed detailed
107x The offer was shown this month


text:
Toddlers & Tiaras
The Georgia Jinx
Season 9 Episode 7
After a tough loss to the Top Model, Cambrie's Court travels to Georgia for the Cowgirls & Crowns Pageant, Cambrie brings heavy hitter (and Trump supporter!) Landri, to battle Top Model's big winner Saymone. Can Cambrie's Court make a comeback?
- 43 min
- Premiered 10/05/2016


text:
The colonnade tray table floor lamp for Robert Abbey pulls double duty with modern beauty. The frame of polished nickel finish pulls together two oval base trays. The top tray made of delicate tempered glass is perfect for displaying your favorite collections or photos. A carrara marble base grounds the piece and continues its shape to the top oval open weave white linen shade for added drama. A convenient Hi-Lo dimmer switch allows easy adjustment of ambient light. Perfect for areas where light and surfaces are needed but space is limited.
Family-owned for over 80 years, Robert Abbey is an established leader in lighting excellence and one of the most prominent U.S. lighting manufacturers. Their passion for excellence continues to shine through in their European inspired chandeliers, wall sconces, pendant lights, bath lighting and more. Our sleek, contemporary Robert Abbey designs will be distinctive and stylish additions to your home décor.
Our team has over 100 years combined experience with contemporary lighting.
Every EuroStyleLighting.com order is backed by our 100% Satisfaction Pledge.
Shipping and Delivery Information - For item EU4Y151 if ordered by 1 pm Pacific Time


text:
The display and use of drug information on this site is subject to express terms of use. By continuing to view the drug information, you agree to abide by such terms of use.
DRUG INTERACTIONS: See also How to Use section.Your doctor or pharmacist may already be aware of any possible drug interactions and may be monitoring you for them. Do not start, stop, or change the dosage of any medicine before checking with your doctor or pharmacist first.Before using this medication, tell your doctor or pharmacist of all prescription and nonprescription/herbal products you may use, especially of: estrogens, birth control pills, medications that can cause bone loss (e.g., corticosteroids such as prednisone).This medication may interfere with certain laboratory tests (including tests for pituitary gonadotropic and gonadal functions), possibly causing false test results. Make sure laboratory personnel and all your doctors know you use this drug.This document does not contain all possible interactions. Therefore, before using this product, tell your doctor or pharmacist of all the products you use. Keep a list of all your medications with you, and share the list with your doctor and pharmacist.
OVERDOSE: If overdose is suspected, contact a poison control center or emergency room immediately. US residents can call their local poison control center at 1-800-222-1222. Canada residents can call a provincial poison control center.
NOTES: Do not share this medication with others.Laboratory and/or medical tests (e.g., growth/bone age velocity in children) should be performed periodically to monitor your progress or check for side effects. Consult your doctor for more details.
MISSED DOSE: It is important that you do not miss any doses of this medication. If you do miss a dose, use it as soon as you remember. If it is near the time of the next dose, skip the missed dose and resume your usual dosing schedule. Do not double the dose to catch up.Vaginal bleeding may occur in girls/women who miss doses of this medication.
Quick GuideEndometriosis Symptoms, Stages, Treatment
Report Problems to the Food and Drug Administration
You are encouraged to report negative side effects of prescription drugs to the FDA. Visit the FDA MedWatch website or call 1-800-FDA-1088.
Selected from data included with permission and copyrighted by First Databank, Inc. This copyrighted material has been downloaded from a licensed data provider and is not for distribution, except as may be authorized by the applicable terms of use.
CONDITIONS OF USE: The information in this database is intended to supplement, not substitute for, the expertise and judgment of healthcare professionals. The information is not intended to cover all possible uses, directions, precautions, drug interactions or adverse effects, nor should it be construed to indicate that use of particular drug is safe, appropriate or effective for you or anyone else. A healthcare professional should be consulted before taking any drug, changing any diet or commencing or discontinuing any course of treatment.
Need help identifying pills and medications?
Use the pill identifier tool on RxList.


text:
The above graph displays service status activity for Answers.yahoo.com over the last 10 automatic checks. The blue bar displays the response time, which is better when smaller. If no bar is displayed for a specific time it means that the service was down and the site was offline.
Service Status History
|Ping Time
|Ping Time
|6.67 ms.
|7.38 ms.
|16.68 ms.
|17.1 ms.
|6.08 ms.
|7.21 ms.
|596.34 ms.
|17.1 ms.
|7.13 ms.
|17.97 ms.
* Times displayed are PT, Pacific Time (UTC/GMT 0) | Current server time is 12:53
We have tried pinging Yahoo Answers website using our server and the website returned the above results. If answers.yahoo.com is down for us too there is nothing you can do except waiting. Probably the server is overloaded, down or unreachable because of a network problem, outage or a website maintenance is in progress...
If the site is UP but you cant access the page, try one of the below solutions:
Browser Related Problems
Force a full refresh for the site. This can be achieved by pressing CTRL + F5 keys at the same time on your favourite browser (Firefox, Chrome, Explorer, etc.)
Clear the temporary cache and cookies on your browser to make sure that you have the most recent version of the web page. For instructions choose your browser :
Fix DNS Problems
A Domain Name System (DNS) allows a site IP address (192.168.x.x) to be identified with words (*.com) in order to be remembered more easily, like a phonebook for websites. This service is usually provided by your ISP.
Clear your local DNS cache to make sure that you grab the most recent cache that your ISP has. For Windows - (Start > Command Prompt > type "ipconfig /flushdns" and hit enter). For details choose your operating system :
If you can access a website at office or from a 3G network yet it's not working on your computer, it is a good idea to use an alternative DNS service other than your ISPs. OpenDNS or Google Public DNS are both excellent and free public DNS services.
Check our help page for step-by-step instructions on how to change your DNS.
It's said unable to connect for several hours. No problems with any other site.
says this"We are experiencing some problems, please try again."
At the moment Y/A seems to be on the fritz again. Very hard to get through to the answers and to answer questions. Lot's of wait time for pages to load, or have to try several times to get through.
Every time I try to click on a yahoo answer off of Google, there is nothing on the page. I can go to answers,yahoo.com, but when I ask a quesiton, and click on it, the page has nothing on it.
16th April... Yahoo Answers is still down. Cannot seem to ask any questions, cannot login, cannot view any questions asked either. Very interesting. This website claims that it is actually up, so if so why is it obviously not?
even after it's finished loading, the site is just a blank white page. i cant view any sort of content
When I'm viewing Y! Answers as a guest, everything is fine... But when I log in, suddenly the page won't load at all- it's completely blank. I tried on my PC, just to be sure, and had the same problem. What gives?
Down as of 3/30/16 at 12:26 pm est
I am noticing everytime I try to post any link, the answer never appears when logged out. Is anyone else experiencing this issue?
Once again, down. What is with these sites lately? Paypal and FedEx were down this week also. Maybe just nuke all the questions and start all over. -10 year member
Yahoo answers has been having more problems than usual lately. Does anybody know what is going on?
Smh, it looks like it's down again.
Well actually it is working now. It's still a little sluggish, but not too bad.
Of course it's down- the fight in Chicago didn't go off, and now America needs shut up. Political stuff might happen if we ask too many questions and supply the "wrong" answers.
Yeah, YA is down again. It was only working for 24 hours and now it's back to being very very hard to get through so the questions show up. Requiring several refreshes to get through, and running very slow also.
No questions are showing on the homepage and I can't ask any
Page is not loading correctly, very slow, and mostly shows "This question does not exist or is under review."
every category says there are no questions posted. When you click on all categories, questions pop up, when you answer them and hit "submit" it says there's a problem and wont go through. It's been like this for days now. Please fix it! TY!
Site is starting to give problems again in the last hour. Resembles exactly what happened Saturday morning -- have to hit refresh like 10 times to get to a question, questions come up as saying they don't exist once you click on them, etc. Frustrating that this system can't be maintained any better.
Beyphone, yeah you're right. Just checked. I got trough instantly.
I think it's back up, at least for now.. it seems to be working fine again.
I find it odd that Yahoo would not post something about a service disruption that has been going on all day. That makes me wonder if the theory some are floating about the whole system being disbanded might have something to it. At least that's what the conspiracy theorist in me is thinking. Hopefully it will be back up later today.
Yeah, it's down for me also. I can get to questions but only if I just keep refreshing the page over and over again multiple times. Usually it's taking 10 to 25 refreshes to get through. Also, since it's so hard to get in, very few questions are being asked and answered. I guess only the people who are really determined to get through are sticking with it and must be refreshing like crazy. I gave up. Anyway, you have to refresh at the perfect time when the site opens up for a couple of seconds.
yahoo is down for me too
can't ask my question dammit
I can't even see questions. Every link I click, I get "This question does not exist or is under review."
This time it looks like Yahoo is ready to dump its answers- Why leave it up when the public might influence how the public thinks- during an election?
Has anyone ever experienced YA being down this long? It's been over 12 hours now.
Says I reached my daily limit... haven't even posted at all today. Site is down..
Most of the answers are coming up as either deleted or under review, loads up but answers are missing, loads up but page is blank white, or every now and then it works. But it has been acting like this for the past 12 hours or so.
It's gotten worse throughout the day until it has reached the point that there is no content whatsoever. Either their Answers servers are offline or wiped, or they are killing Answers completely, without telling us.
I can't go on my profile on Y!A and can't see answers and comments.
Yeah, it's down. The page comes up, no questions come up
When I his submit to answer a question nothing happens.
same problem here. I asked a legitamate question & after repeatiedly refreshing, i continue to get the message, "This question does not exist or is under review." I've looked at other peoples questions & seent he same message so I'm glad it's not me 'cause i've been suspended before for "turning it into a forum," which was stupid as all I did was ask someone to clarify. lol.
Whenever I try to acces a question I get "
This question does not exist or is under review."
For the last couple of hours, when I try to post a question on Yahoo Answers, I'm getting:
Sorry, we couldn't post your question right now. Please try again later.
I think Y!A's software just sucks, it can't tell the difference between something where it doesn't like the message contents and when a server isn't responding.
Can't post a question..ugh so annoying
Yahoo Answers, Search, Weather, Games, and Mail come up as gibberish. Other areas (news, sports, finance) seem unaffected.
it wont let me post a question. please help!
Site won't load at all
Not working now
I am currently having problems with yahoo answers. Not a single webpage will load.
Yahoo answers won't load . Every page I go is empty or it leads back to my profile .
When I try to post a question on Yahoo Answers, I'm getting:
Sorry, we couldn't post your question right now. Please try again later.
When I try to post a question on Yahoo Answers, I'm getting:
Sorry, we couldn't post your question right now. Please try again later.
I can't award best answer on facebook or comment at all
My computer blocked from answering or awarding best answer? I figured out how to fix the issue.
when i click on yahoo answers, nothing happens. get the "he's dead, jim" message.
i can see the questions but when i try to scroll down. all of the answers keep moving towards the bottom of the page. cant read anything.
Yes... so it's down. Life does go on people. It's the internet... stuff happens! There are millions of great sites... an endless supply of fun, reading, news, etc., etc. Or even stuff to do away from the computer. Since I'm at work... I may just consider working.
Won't let me do anything... this is bull crap
Down for me :(
wow this site is down.. first time it happened for me
yahoo answers is down .. will not let anyone post questions
Yahoo answers is down, every other question is deleted. It's really slow, something is not right. I can't even access my yahoo answers profile page.
Submit a comment using your Facebook ID.
Is Answers.yahoo.com down for you right now? Submit your comments about Answers.yahoo.com service status or report an issue below to let others know that they aren't the only ones having trouble. Please note that your country, service provider and browser information will be displayed next to your comment to better analyze a possible outage.


text:
The great thing about the Roku set-top box is how easy it is to set up, and watch Netflix (and other Internet fare) on the TV.
The downside: you could only pick movies and TV shows that were already in your Netflix "cue." Not any more.
Roku updated the Netflix app to allow for movie and TV selection from the TV itself. You can browse and search Netflix titles from the TV and add fare to the Instant Queue for later viewing.
Roku, which sells set-top boxes for $79.99 to $129.99, is a little late to the party. Netflix apps for the Xbox 360 and PlayStation 3 video game consoles already offered browsing (comedy, drama, classics, etc.) capability. They didn't let users search for specific titles, however, and Roku has both.
Besides Netflix, the Roku box also offers content from Amazon, Major League Baseball and Pandora Internet radio.
Roku won't say when the app will go live -- just sometime "this month," says Roku spokesperson Brian Jaquet. The company decided to let folks know about the app ahead of time, "because we wanted customers to know that this was coming, and that weren't sitting idle."
Below, a teaser video Roku released to YouTube Wednesday highlighting the upgraded Netflix app.
By Jefferson Graham
Technology Live covers computers, electronics, and the Internet, with a focus on cutting-edge technology that has a real impact on your life. Our reporters and editors -- based in San Francisco, Los Angeles, Seattle, New York, and Washington – offer news and tips to help you make the most of your digital domain. More about the team
Sign up for Technology Live e-mail alerts


text:
It only takes a minute to get started. Fill out our uncomplicated sign up form and login to the site.
This step is elective but will dramatically multiply your chances of getting interest from other over 40s members on the site. Type a little about yourself, your interests and atach your nicest photo of yourself.
Utilise our website's cutting-edge search to pinpoint over 40s members who satisfy your needs. Or just scan through listings and pinpoint singles that take your fancy.
Discovered someone who you like the look of? Send an email to them or just a wink and await their reply. With a little luck you'll be on your way to an amazing adventure.
And start dating


text:
Michael Skleney Photographer
Angela MorterModel Female Plainfield, Illinois, US
My Website: http://www.myspace.com/tonyssexiangMy MM URL: http://www.modelmayhem.com/AngelaMorter
Mayhem # 1283946
About MeAny little girls dream is to model someday, i dont care who they are. It ran threw there mind. I have done hair and make up on people sense I was little. And iI think it's my turn to be behind the camera. I am a hair stylest right now so i know the look. So please let me put it out there. I am passionate about this and i would be the happiest person alive to have this dream come true.
Have you worked with Angela Morter? Add Credits for Angela Morter! >>
Credit NotesThankyou
Michael Skleney Photographer
Malicious Mike Model
Owens Roberts Photographer
Ionu Photography Photographer
ACertainLook Photographer
Blinkit Photography Photographer
Loading Content


text:
you'd wish by philippe-artWatch
©2014-2017 philippe-art
One of the rare case in which I like the shot, the idea, but not the model.
you've a shaped body like a greek statue, but better as you aren't cold stone there is something hypnotic in the uhm "flow" of the bit twisted muscles from your chest to the legs, and something very fascinating )
I'd wish??
Nope, I'd beg....
Nope, I'd beg....
Oh. My. God. Talk about getting a sense of antici ... ... ... pation! Great shot.
guerlain ?
She is perfection personified & your images are gorgeous.
Well, this gorgeous young woman has one of those "one in a thousand" midriffs that are simply amazing to see.
dark side of deviantart again....
I love that this shot manages to be sexy and revealing without actually showing us anything. It's tasteful, sensual, shows off the beautiful model, and is an interestingly composed shot in its own right. Well done, added to faves.
Thats Hot, very pretty model
beautiful model with a fantastic figure , love the shoot, sexy showing just enough skin.