text:
Solar Power For Your Home More Appealing Than
House improvement loans can add value to your house. If he wants to offer the residence, this assists homeowners in settlements for the much better offer. Apart from industrial perspective, home supplies comfort in real sense. House improvement loans are offered to individuals for the function of making house a much better place to reside in. There are lots of factors of making changes to the home. It relies on people's selection and interest.
The buzz discovered in Amps have insulation contractor actually always been a little bit on the low side; not by a lot, but Solar Power Amp is usually around 140-150mg of caffeine as compared to the 156mg of caffeine found in below. Solar Power is probably the many points connected with Solar Power. WHen you add in the extra little life from the guarani, there is enough energy in right here to give a Beast or Red Bull's amount of power.
Energy Secretary Chu mentioned to an audience Saturday that Some claim this is a race America cannot win, potentially referring to Chairman Stearns. They prepare to wave the white flag and proclaim defeat. Chu stated there was a multi trillion dollar worldwide market in solar panels. He thinks the U.S. must contend for a big share of that market.
Secured mortgage at competitive rates are extremely comparable to Green Energy home mortgages. The mortgage can help you acquire a house or to construct one, the secured loan can do the same. Nevertheless, protected home loans at competitive rates can be used for a great deal of various other functions also, like purchasing an automobile or whatever you could want, however you do not have the necessary funds.
Solar panel kits are commonly offered and the solar panels themselves can be set up Home Improvement in your side yard, on your rooftop or the can be camouflaged as roofing shingles or glass facades. Some panels are even made to rotate so that they follow the rays of the sun across the sky. This last selection offers you with the most quantity of sunlight collection.
Solar energy can help you conserve cash while producing electricity for your home. Not only is it a really cost efficient system, but also you may even have the ability to produce enough power that you will have extra energy which you would have the ability to sell it back to the power company. The sunniest areas can permit you to install a solar system that might go off-grid. The electrical energy from your solar photovoltaic cells is saved into a battery much like an automobiles battery. In areas with less sunshine, you may consider piggybacking solar with a standard system. This would enable you to get electrical energy on cloudy and sunny days.
And yes, you can have the cake and eat it too. Get a good guide, build your own solar panels, produce your own House Solar energy System, and start tapping on sustainable renewable energy now.


text:
Publication number | US7606444 B1 |
Publication type | Grant |
Application number | US 11/942,706 |
Publication date | Oct 20, 2009 |
Filing date | Nov 19, 2007 |
Priority date | Nov 29, 2002 |
Fee status | Paid |
Also published as | US7298930 |
Publication number | 11942706, 942706, US 7606444 B1, US 7606444B1, US-B1-7606444, US7606444 B1, US7606444B1 |
Inventors | Berna Erol, Jamey Graham, Jonathan J. Hull, Dar-Shyang Lee |
Original Assignee | Ricoh Company, Ltd. |
Export Citation | BiBTeX, EndNote, RefMan |
Patent Citations (6), Non-Patent Citations (1), Referenced by (41), Classifications (12), Legal Events (1) | |
External Links: USPTO, USPTO Assignment, Espacenet | |
This application is a divisional application of application Ser. No. 10/307,235, filed Nov. 29, 2002 now U.S. Pat. No. 7,298,930, which is hereby incorporated by reference for all purposes.
This application is related to the following commonly owned and co-pending U.S. Patent Applications which are hereby incorporated by reference for all purposes:
The present invention relates generally to multimedia meeting recordings and more specifically to access of multimedia meeting recordings.
Progress in the business world typically finds its beginnings with a series of meetings. Meetings are usually drawn out unstructured affairs, consisting of mostly irrelevant information. However, there usually are one or two defining moments that occur during a meeting which can propel the enterprise in the forward direction toward success, or if missed, can result in yet another failed business venture.
Many businesspersons visit remote locations and participate in meetings with different people on a regular basis. A common task that must be performed at some time after the meeting is the creation of a summary of what happened during the meeting. The summary may include reports of who said what, the ideas that were conceived, the events that occurred, and the conclusions that were reached. Oftentimes, it is not just the specific conclusions but also the reasons they were reached and the points of view expressed by the meeting participants that are important.
Producing an accurate meeting summary is a time-consuming and error-prone process, especially if the only record available is one's own memory, perhaps supplemented with hastily handwritten notes. A commonly used portable memory aid is the audiocassette recorder. It can be effective, but lacks the ability to capture important events that could be helpful later, such as gestures, images of participants, body language, drawings, and so on. An easy-to-use method for incorporating video data would help solve this problem.
Meeting recordings can help. Capturing the content of meetings is useful in many respects. Recordings of a meeting can capture the meeting activity and then later be reviewed as needed to refresh one's memory. Knowing that a meeting is being recorded allows the participants to more effectively concentrate on the meeting discussion since the details can be later reviewed in an offline manner. Audio-visual recordings of meetings provide the capability for reviewing and sharing meetings, clarifying miscommunications, and thus increase efficiency.
Recognizing this need, several meeting recorder systems have been developed in recent years. A multimodal approach to creating meeting records based on speech recognition, face detection and people tracking has been reported in CMU's Meeting Room System described by Foote, J. and Kimber, D., FlyCam: Practical Panoramic Video and Automatic Camera Control, Proceedings of International Conference on Multimedia & Expo, vol. 3, pp. 1419-1422, 2000. Gross, R., Bett, M. Yu, H., Zhu, X., Pan, Y., Yang, J., Waibel, A., Towards a Multimodal Meeting Record, Proceedings of International Conference on Multimedia and Expo, pp. 1593-1596, New York, 2000 also describe a meeting recorder system.
However, people generally prefer not want to watch a recorded meeting from beginning to end. Like the meeting from which the recording was produced, recorded meetings are not amenable to a hit-or-miss search strategy. After fast-forwarding a few times in a meeting video while looking for something, most people will give up unless what they are seeking is important enough to suffer the tedium.
More often than not, people are only interested in an overview of the meeting or just the interesting parts. Enabling efficient access to captured meeting recordings is essential in order to benefit from this content. Searching and browsing audiovisual information can be a time consuming task. Two common approaches for overcoming this problem include key-frame based representations and summarization using video skims. Key-frame based representations have proven to be very useful for video browsing as they give a quick overview to the multimedia content. A key-frame based technique is described by S. Uchihashi, J. Foote, A. Girgensohn, and J. Boreczky, Video Manga: Generating Semantically Meaningful Video Summaries, ACM Multimedia, (Orlando, Fla.) ACM Press, pp. 383-392, 1999.
On the other hand, video skims are content-rich summaries that contain both audio and video. Efficiently constructed video skims can be used like movie trailers to communicate the essential content of a video sequence. For example, A. Waibel, M. Bett, et al., Advances in Automatic Meeting Record Creation and Access, Proceedings of ICASSP, 2001 propose summarization of meeting content using video skims with a user-determined length. The skims are generated based on relevance ranking and topic segmentation using speech transcripts.
A summarization technique for educational videos based on shot boundary detection, followed by word frequency analysis of speech transcripts, is suggested by C. Taskiran, A. Amir, D. Ponceleon, and E. J. Delp, Automated Video Summarization Using Speech Transcripts, SPIE Conf. on St. and Ret. for Media Databases, pp. 371-382, 2002.
A method for summarizing audio-video presentations using slide transitions and/or pitch activity is presented by He, L., Sanocki, E., Gupta, A., and Grudin, J., Auto-summarization of audio-video presentations, In Proc. ACM Multimedia, 1999. The authors suggest a method of producing presentation summaries using video channel, audio channel, speaker's time spent on a slide, and end user's actions. The authors discuss the use of pitch information from the audio channel, but their studies showed the technique as being not very useful for summary purposes. Instead, they indicate that the timing of slide transitions can be used to produce the most useful summaries.
Motion content in video can be used for efficiently searching and browsing particular events in a video sequence. This is described, for example, by Pingali, G. S., Opalach, A., Carlbom, I., Multimedia Retrieval Through Spatio-temporal Activity Maps, ACM Multimedia, pp. 129-136, 2001 and by Divakaran, A., Vetro, A., Asai, K., Nishikawa, H., Video Browsing System Based on Compressed Domain Feature Extraction, IEEE Transactions on Consumer Electronics, vol. 46, pp. 637-644, 2000. As a part of the Informedia™ project, Christel, M., Smith, M., Taylor, C. R., and Winkler, D. Evolving Video Skims into Useful Multimedia Abstractions, Proc. of the ACM CHI, pp. 171-178, 1998 compared video skimming techniques using (1) audio analysis based on audio amplitude and term frequency-inverse document frequency (TF-IDF) analysis, (2) audio analysis combined with image analysis based on face/text detection and camera motion, and (3) uniform sampling of video sequences. They reported that audio analysis combined with visual analysis yield significantly better results than skims obtained purely by audio analysis and uniform sampling.
In Sun, X., Foote, J., Kimber, D., and Manjunath, Panoramic Video Capturing and Compressed Domain Virtual Camera Control, ACM Multimedia, pp. 229-238, 2001, a user-oriented view is provided based on speaker motion. A perhaps more intuitive solution is to compute the speaker direction as suggested by Rui, Y., Gupta, A., and Cadiz, J., Viewing Meetings Captured by an Omni-directional Camera, ACM CHI 2001, pp. 450-457, Seattle, March 31-Apr. 4, 2001. Techniques such as summarization and dialog analysis aimed at providing a higher level of understanding of the meetings to facilitate searching and retrieval have been explored by Hauptmann, A. G., and Smith, M., Text Speech and Vision for Video Segmentation: The Informedia Project, Proceedings of the AAAI Fall Symposium on Computational Models for Integrating Language and Vision, 1995.
Analysis of the audio signal is useful in finding segments of recordings containing speaker transitions, emotional arguments, and topic changes, etc. For example, in S. Dagtas, M. Abdel-Mottaleb, Extraction of TV Highlights using Multimedia Features, Proc. of MMSP, pp. 91-96, 2001, the important segments of a sports video were determined based on audio magnitude.
In a paper by Bagga, J. Hu, J. Zhong and G. Ramesh, Multi-source Combined-Media Video Tracking for Summarization, The 18th International Conference in Pattern Recognition (ICPR'02) Quebec City, Canada, August 2002, the authors discuss the use of text analysis (from closed captioning data) and video analysis to summarize video sequences. Text analysis is performed to find topics by using a similarity measure based on Salton's Vector Space Model. Visual analysis is based on dominant color analysis. Feature vectors found by text and visual analysis are normalized, combined into one feature vector, and hierarchical clustering is used for final clustering. Clustering is performed across multiple videos to find the common news stories. These stories are then used in the summary. Their technique identifies similarities across different video tracks.
Speech content and natural language analysis techniques are commonly used for meeting summarization. However, language analysis-based abstraction techniques may not be sufficient to capture significant visual and audio events in a meeting, such as a person entering the room to join the meeting or an emotional charged discussion. Therefore, it can be appreciated that continued improvement in the area of processing meeting recordings is needed to further facilitate effective access and retrieval of meeting recording information.
A method for creating video skims is based on audio and visual activity analysis together with text analysis. In an illustrative embodiment of the invention, detection of important visual events in a meeting recording can be achieved by analyzing the localized luminance variations in consideration with the omni-directional property of the video captured by our meeting recording system. In another illustrative embodiment, audio activity analysis is performed by analyzing sound directions—indicating different speakers—and audio amplitude. A further aspect of the present invention is incorporation of text analysis based on the Term Frequency-Inverse Document Frequency measure. The resulting video skims can capture important segments more effectively as compared to the skims obtained by uniform sampling. It can be appreciated that the techniques according to the present invention can be applied to any multimedia recording, wherein meeting recordings constitute only a subset of the broader category of multimedia recordings.
An understanding of the present invention is provided by the following figures along with the discussion that follows, where:
From the following it will be appreciated that the present invention has broad application generally to multimedia information. However, to facilitate a discussion of the invention sufficient to enable its practice, the present invention will be described in the context of a meeting recording system. As will become apparent, a meeting recording system can prove to be a rich source of various modes of information and thus serves as an appropriate example for describing the numerous aspects of the present invention. However, it is nonetheless noted that many aspects of the present invention are generally applicable to the broader category of "multimedia content."
The meeting recording and access system exemplar shown in
The meeting recorder 102 may further comprise an audio recording system 104 b to produce an audio recording of the conversations of the meeting participants, including other sound sources such as a video presentation, output from a speaker phone, etc., and in general can include any sound that might occur during the meeting (e.g., slamming of a door, sound of a fire engine or an airplane passing by, etc.). Typically, the audio recording system includes a plurality of microphones to pick up the different speakers, and as will be explained, to allow for locating sound sources.
In a particular embodiment of the invention, the audio recording system can also provide sound localization information. For example, sound data can be collected with microphone arrays. Subsequent processing of the data by known sound localization techniques, either in real-time or off-line, can be employed to find the direction of the sound. In a particular embodiment of the invention, sound localization is performed in real-time to avoid the need of handling and saving multiple channels of audio data. This approach may be suitable in a compact configuration such as in a portable system, for example.
The audio signal is processed in segments of 25 msec. Since we are interested only in human speech, segments that do not contain speech in at least one of the sound channels can be ignored. Following speech detection, 360-degree sound localization can be determined in the following manner. For each pair of microphones that are diagonally situated, an angle between 0 and 180 degrees is calculated based on phase difference. This angle defines a cone of confusion centered at the midpoint of the diagonal. In theory, the intersection of two cones computed from both diagonal pairs defines the azimuth and elevation of the sound source. Unfortunately, the angle computed by each pair is not perfect. Moreover, phase difference measured on a finite sampling rate over a small baseline is discrete, and the angular resolution over all directions is non-uniform. Higher resolution is obtained near the center, and is lower towards both ends. Therefore, we need to compute the intersection of two cones of unequal thickness, if they intersect at all. Furthermore, we want to take into consideration the confidence associated with each angle estimate.
To resolve these issues, we use an accumulator over the parameter space of azimuth by elevation. Azimuth varies from 0 to 360 degrees and elevation varies from 0 to 90 degrees. For each possible (azimuth, elevation) pair covered by each cone, its entry is incremented by the confidence associated with the cone. The highest scoring entry in the accumulator corresponds to the best parameter estimate. All entries in the accumulator are decayed by a factor at the end of each segment. However, in trying to estimate both azimuth and elevation, we found the solution unstable and sensitive to the quantization chosen. Furthermore, it does not account for the fact that sound sources close to the middle are detected more accurately than those close to either end. Therefore, the scores at all elevations are summed up for each azimuth, and the best azimuth is returned if its score exceeds a threshold. Then, for each segment where speech is found, a triplet of time-stamp, angle, and score, denoted by (t, θi, wi), is written to a file. We observed this process is capable of performing in real-time, consuming approximately 25% to 40% CPU load on a 933 MHz PC.
Text capture devices 104 c can be incorporated into the meeting recorder 102. For example, a scanner can be provided to allow scanning of documents that are handed out during the meeting. Notes generated during the meeting can be scanned in The text capture can include associating some form of information identifying the originator of the text being captured.
As a catch-all, it can be appreciated that other capture devices 104 d can be incorporated into the meeting recorder 102. For example, slides from a slide presentation can be captured. Where a whiteboard is used, one can appreciate that the contents of the whiteboard can be captured using appropriate known whiteboard capture techniques. Meeting participants can use graphics tablets or similar input devices to record handwritten notes. Such devices can facilitate the capture of notes by obviating the step of scanning in notes written on conventional media such as paper.
A metrics generator functionality 106 produces a variety of metrics from the various information collected in accordance with the invention (additional details about the computations provided below) and then can be stored in the storage component 112. In one embodiment of the invention, the information can feed directly to the metrics generator from the various data capture device 104 a-104 d. In another embodiment, the source data for the metric generator can be obtained from the storage component 112 in an off-line manner.
An access engine functionality 124 provides access to the information contained in the storage component. As will be explained below, the captured information can be selected in accordance with the invention based on various combinations of the computed metrics. An interface engine functionality 122 provides an appropriate user interface to the access engine functionality. For example, a graphical user interface (GUI) may be appropriate to facilitate browsing the recorded meeting information. It is noted here that a "user" need not be a conventional human user. Another machine can serve as the "user" of the present invention. In such a case, the interface engine functionality can be defined by an appropriate data exchange protocol. The interface engine functionality can simply be a suitable application programming interface (API), defining a library of utilities to facilitate implementing a suitable GUI, or a machine interface, or even a simple command line interface (CLI).
The discussion will now turn to various metrics that can be produced by the metrics generator functionality 106 according to the present invention. Consider first the video information collected by the video capture functionality 104 a. In accordance with an embodiment of the present invention, the video is captured with an omni-directional camera and converted to the MPEG-2 data format for storage and subsequent access.
In a video of a typical meeting sequence, most of the time there is minimal motion. High motion segments of video usually correspond to significant events. For example, a participant getting up to make a presentation, someone joining or leaving the meeting, or just making gestures, could be important for searching and recalling some segments of the meeting.
In accordance with the invention, a visual significance measure is generated based on local luminance changes in a video sequence. A large luminance difference between two consecutive frames is generally an indication of a significant content change, such as a person getting up and moving around. However, insignificant events, such as dimming the lights or all the participants moving slightly, may also result in a large luminance difference between two frames. In order to reduce the likelihood of identifying such events as being significant, the visual significance measure, according to an embodiment of the invention, can be determined by considering luminance changes occurring in small windows of a video frame rather than a single luminance change of the whole frame.
The luminance changes can be computed by computing the luminance difference between the consecutive intra coded (I) frames in the MPEG-2 compressed domain. We employ I-frames because the luminance values in I-frames are coded without prediction from the other frames, and they are therefore independently decodable. We compute luminance differences on the average values of 8�8 pixel blocks obtained from the DC coefficients. The DC coefficients are extracted from the MPEG bit stream without full decompression. Average values of the 8�8 pixel blocks are found by compensating for the DC prediction and scaling. In a particular implementation, the DC coefficients are obtained from the bit stream using a modified version of the publicly available TMN MPEG-2 decoder available at the FTP site:
Since the video is recorded using an omni-directional camera, the image is doughnut-shaped. As can be seen in
The weights of the pixels are assigned to compensate for this ratio when computing the frame pixel differences. The assignment of weights is accomplished by considering the parabolic properties of the mirror as follows:
where r is the radius of the DC coefficient location in frame centered polar coordinates and Rmax is the maximum radius of the donut image. The coefficients that do not contain any information (the location that corresponds to outside of the mirror area) are weighed zero.
We employ a window size of 9�9 DC coefficients, which corresponds to a 72�72 pixel area, though it can be appreciated that other suitable window sizes corresponding to different pixel areas can be used. The weighted luminance difference is computed for every possible location of this window in a video frame. A local visual activity measure (score), Va, can be defined as the maximum of these differences as follows:
On the other hand, the video frames shown for event (b) are deemed not to have visual significance, since the activity is simply the person moving closer to the camera. Nonetheless, this segment has a large corresponding activity value 402 b because the motion toward the camera appears as a large moving object due to the change in perspective. Exclusion of such segments from the category of important visual events can be achieved if we compensate for the distance of the objects from the camera by utilizing techniques such as stereovision. Despite this anomalous behavior, it can be appreciated that the foregoing local visual activity score can nonetheless serve as the basis for determining a visual significance metric for a frame of video. As will be discussed below, the visual significance metric in turn can serve as a basis for identifying visually significant events in a video recording.
Another aspect of the metric generation functionality 106 shown in
In accordance with the present invention, we combine audio amplitude information with sound localization information from our meeting recorder system. It was discovered that sounds coming from different directions in a short time window indicates a discussion among several speakers potentially of a salient topic, and thus warrants attention as a significant audio event.
Thus, in accordance with an aspect of the invention, we define a speaker activity measure, Sa, as:
Audio activity measure, Ua(t), is defined as:
where Sa(t) is speaker activity at time index t, f is the audio sampling frequency, and X(n) is the audio amplitude of the nth sample. In accordance with this particular embodiment of the invention, the audio activity measure is the basis for the audio significance score.
The audio activity plot 504, exhibits high regions 522 and 524, which correlate with the speaker activity shown in the dialog boxes. For example, the dialog box 512 indicates an exchange of ideas among four speakers. The speaker activity is illustrated in the region 522 of the sound localization plot 502, indicating a local increase in the rate of change of the sound location. The speaker activity is shown by the peaks in the corresponding region of the audio activity plot. Similarly, the dialog box 514 indicates an even more animated interchange of ideas. This can be seen by inspecting the corresponding period of time on the sound localization plot 502 at region 524. The corresponding region of time on the audio activity plot 504 shows a region of peaks in the audio activity metrics.
It can be appreciated therefore that by analyzing various parameters of these audio plots, significant audio events can be identified. For example, it was discovered from initial experiments with several recordings of staff meetings, presentations, and brain storming sessions, that the peaks in the audio activity plot 504 bear a correspondence to the audio clips with a high degree of meeting participant interactions and few silent periods.
Still another aspect of the metric generation functionality 106 shown in
This measure is employed in our system as follows, referring to
In order to find when a given keyword most frequently occurs, we divide the audio transcriptions into audio segments 710 of some duration (e.g., transcriptions of 10-second audio clips) and compute a document occurrence score DOk as follows:
In a step 604, significance scores are computed from the captured recorded meeting information. For example, in an embodiment of the invention, a visual significance score (Va) can be produced for each video frame of the video component of the captured recording meeting based on local luminance metrics computed for that frame, such as discussed above. Similarly, an audio significance score (Ua) can be computed in the manner described above, using sound localization information contained in the audio component of the recording meeting. Transcripts can be generated from the audio component and processed so that each of a number of keywords identified in the transcript can be associated with one or more audio clips (keyword audio segments) that are deemed to be significant with respect to that keyword.
Next, in a step 606, the computed scores generated in step 604 can be ranked; e.g., sorted by magnitude. In accordance with an embodiment of the present invention, the visual significance scores (Va) and audio significance scores (Ua) are sorted. Similarly, computed keyword audio segments (those with the highest DOk values) are sorted according to the TF-IDF of the keywords.
Access to the meeting recording can be provided in the form of extracted portions of the meeting recording, in a step 608, based on one or more of these scores. In a particular implementation of the invention, the extracted content can be presented as a video skim (comprising, for example, video and audio) that is played on a suitable display; e.g., an audio-video capable system such as a PC with speakers. A video skim can be produced based on a visual significance score. Alternatively, the video skim can be based solely on an audio significance score. Still another alternative is a video skim based on a combination of two or more of these and other scores, or on a composite score computed as a function of two or more of these and other scores.
Suppose the recorded meeting is accessed as a one minute video skim based solely on a given visual activity score. A video frame having that score is selected from the recorded meeting data and can be the basis from which the video skim is produced. In this case, the video skim might comprise a one minute segment of consecutive video frames (video clip) from the recorded meeting starting with the selected video frame. Alternatively, the video clip might be selected from the recorded meeting such that it ends with the selected video frame. A segment of the recorded meeting can be selected which includes the selected video frame somewhere in the video clip. If appropriate, the video clip might even be a segment of the recorded meeting that precedes (or follows) the selected video frame by some amount of time. It might be desirable to compose the one minute video skim by combining a series of shorter video clips of equal or unequal duration. The video clip can be presented as video-only, absent a corresponding audio track. Such a presentation might be desirable, depending on the purpose of the users. Of course, the video skim can include the corresponding audio track.
Depending on performance, storage capacity, and other such criteria, these video skims can be produced on a demand basis; that is, only when a visual significance score is presented. On the other hand, a video skim for some or all of the visual significance scores can be generated offline and stored for later retrieval, thus allowing faster access albeit possibly at the expense of providing substantial storage capacity.
Content of the recorded meeting can be accessed (e.g., a one minute video skim presentation) based solely on a given audio significance score. Again, suppose a one minute video skim is desired. The time index corresponding to the given audio score is determined. In this case, the video skim can comprise a one minute segment of the video (video clip) taken from the recorded meeting based on that time index, including possibly the audio track. The video clip can begin or end at that time index, or the video clip can span a period of time that includes the time index. The video clip might even be for a period of time that is earlier than the time index or is later than the time index. It may be desirable to compose the one minute video skim by combining a series of shorter length video clips of equal or unequal duration. Also, it is possible to store video skims for some or all of the audio significance scores in an offline manner as discussed above.
It can be appreciated that as an alternative to composing and presenting a video skim, an audio-only segment corresponding to the given audio significance score can be presented; though such a presentation may not be as effective as a presentation that includes the video track. However, in situations where no corresponding visual information is available, an audio-track only presentation would be appropriate.
The recorded meeting can be accessed by presenting a video skim that is generated based on a given visual significance score and a given audio significance score. For example, consider again that a one minute video skim is desired. The video skim can comprise a first segment of video based on the visual activity score as discussed above and a second segment of video based on the audio score as discussed above. The segments can be of equal or unequal duration.
It can be appreciated that where two non-consecutive video clips are played back, it may be desirable to "stitch" together the clips in order to smooth out the transition between clips to minimize the distraction of a sudden scene change. For example, a wipe transition (e.g., right to left) can be applied to the video tracks to transition from one clip to the next. Of course, other transitions can be used. Transitioning of the corresponding audio tracks from one video clip to the next can be achieved by audio fades or the like. If any two clips are close in time or if they overlap, they can be merged into a single clip to achieve continuity.
Continuing with
Further in accordance with the invention, the video skim can be produced from plural video frames. In this approach, the first N highest-valued visual significance scores can be selected from the ranked list of visual activity scores (step 604). A video clip can be produced for each of the selected N video scores in the manner described above. The time duration of each video clip can be equal or unequal. The video clips can then be stitched together using suitable transitioning techniques to produce a video skim of the desired duration; e.g., five minutes. The value of N can be a user-specified quantity. It can be appreciated that the duration of each video clip comprising the video skim are dependent on the duration of the video skim and the value of N. Generally, the following relation should hold true:
Similarly, the most significant video skim of a recorded can be based on the audio significance scores. The video skim can comprise the video clip produced based on the time index corresponding to the highest valued audio significance score in the manner discussed above. Where two or more scores have the same highest value, a resolution can be achieved in a manner as discussed above in connection with visual significance scores.
Alternatively, the video skim can comprise a plurality of video clips generated based on the audio scores. Thus, the first M highest audio scores can be selected, from which M time indices can be obtained. The video skim can comprise the plurality of video clips produced based on the time indices in the manner discussed above.
In still another variation, the most significant video skim of a recorded meeting can be composed based on visual and audio significance scores. In a simple composition, the video skim comprises a first video clip based on the highest value visual activity score and a second video clip based on the highest value audio score. Alternatively, the video skim can comprise a first plurality of video clips based on the N highest visual activity scores and second plurality of video clips based on the M highest audio scores.
It can be appreciated that video skims can be generated in various ways using the visual and audio scores. It can be further appreciated that the next most significant video skim could comprise video clips based on the next highest visual activity score, or on the next N highest visual activity scores, or on the next highest audio score, or on the next M highest audio scores, or on both the visual and audio scores.
In accordance with another aspect of the present invention, a single metric can be computed by combining the video, audio, and textual scores to produce a composite score. For example, an arithmetic combination can be performed such as multiplication of the scores, addition of the scores, or some combination of multiplication and addition. Generally, it can be appreciated that some analytical treatment can be performed to produce the composite score.
If the composite score is computed for a meeting moment at time t, a meeting segment can be defined as the meeting recording between [t−Δt, t+Δt]. Segments from the recording meeting corresponding to N such scores can then be selected and combined into a video skim of the meeting recording.
The video skims can be enhanced with additional video clips. The following discussion applies to each of the above-described processes for generating video skims. For example, consider when the most significant event is to be accessed from the recorded meeting. A video skim representing this can be produced in accordance with any one of a number of various embodiments of the invention. As another variation, the video skim can further comprise a video clip extracted from the recorded meeting based on the keyword audio segment metric (DOk) having the highest value. The keyword audio segment and its corresponding video track can be included along with the other video clips which comprise the video skim.
From the foregoing, it can be appreciated that additional modes of information can be captured and incorporated into the process for identifying significant events. These additional modes of information can be captured by appropriate devices collectively represented in
Events may include capture of audio information from speakers during the slide presentation. For example, when the presenter(s) introduce themselves this could be deemed a significant event. When a discussion ensues among the participants, this might signify a relevant event. Another event might be the slide that includes a discussion of the main topic. A significant event is likely to be the slide that the speaker spent the most time discussing. Likewise, a significant event might be the slide that resulted in the most discussion as determined based on the audio activity metric. In addition, these discussion events might involve speech capture of the discussion participants and subsequent transcription of the captured speech. The above-described analytical technique can be applied to the transcribed speech text to produce document occurrence scores DOk, where each keyword k is associated with the audio clip (keyword audio segment) having the highest DOk as described above. The slide(s) presented during the time period spanned by that audio clip can be associated with that keyword.
Another mode of information can be information captured from a whiteboard. Again the text can be captured and transcribed by various whiteboard capture devices which are known and commercially available. Discussion-related events can be detected based on the audio activity score. Keywords from the discussions can be processed by capturing the discussion and converting the captured speech to text. In addition to its associated audio clip (keyword audio segment), each keyword k can be further associated with the captured whiteboard information corresponding to the time period spanned by that audio clip. Other events might include noting when a person steps up to the whiteboard to use it. Such an event can be detected based on a video activity metric generated from the captured video recording.
More often than not, the mainstay of a meeting is paper. The agenda of a meeting is likely to be on paper. The topics of discussion are typically disseminated on paper, a copy provided for each participant. Notes jotted down during the meeting are recorded on paper. This represents a large source of useful text that can be subject to analysis, particularly notes produced during the meeting. The text contained in these papers, can be converted to text via OCR processing. Events can be determined based on the note taking activity. For example, the time-spans can be recorded of when meeting participants take notes. An importance score can be assigned to a time-span based on the number of people taking notes, length of the notes, and so on.
Identification of meeting participants can be used as a basis for enhancing detected events. For example, the video of an event determined to be significant by any of the foregoing techniques can be further analyzed to identify the participants in the video. An importance score can be assigned to the current speaker based on the speaker's rank in the company. Those meeting segments containing higher ranked employees may potentially be more important than other segments. The importance score can be based on speaker dominance. If one or several speakers dominate the meeting, the meeting segments containing those speakers are potentially more important than other segments. The importance score can also be based on the number of active speakers. The first or the last time a speaker speaks can be potentially more important than the rest of the meeting, and so the importance score can include that consideration.
Thus, in accordance with another implementation of the invention, the various modalities (video, audio, various forms of text) can be scored and used to identify significant meeting segments. For example, an importance score can be computed for each modality associated with each second of a meeting. The importance scores can then be combined to produce a significance score, for example by multiplying together all of the scores, or by summing all the scores, or by some other combination. The significance scores can then be ranked.
A video skim might comprise a number of 10-second segments of the meeting recording. For example, the nth most significant video skim of a meeting can be defined as a group of M segments, where the segments are based on the nth group of M consecutive significance scores taken from the ranked list. Thus, the meeting segments comprising the most significant video skim can be selected by taking 10-second segments of the meeting recording at those time indices having the M highest corresponding significance scores.
It was noted earlier that an embodiment of a meeting recorder in accordance with the present invention can be a portable device. A portable meeting recorder offers certain advantages, but presents its own unique challenges. Unlike a meeting recorder which might be based on instrumentation of a conference room where most meetings are carried out in one place, meetings recorded with a portable meeting recorder can take place in different locations. Identifying the meeting location can provide a very useful retrieval cue to facilitate identifying significant segments of a recording of a meeting that comprises many meetings taking place in various locations. One possible solution is to incorporate a GPS device into the portable meeting recorder. However, the accuracy of current GPS technology may not be sufficient to accurately identify the meeting locations, especially considering that they take place indoors.
Referring to
To identify the location, the background images can be matched against room templates in the database. Since the number of placements for the recorder in a particular room is usually limited, the templates can be categorically organized and stored as separate templates. In our case, one template is obtained from each end of a table in a conference room. We match the templates with the backgrounds of the meeting recordings by comparing their color histograms. The histograms are formed in the HSV color space because distance values in this space approximate human perception. The color space represented with 256 bins, where Hue is quantized into 16 bins, and Saturation and Value are quantized into 4 bins each.
Several background images are extracted for each meeting and an intersection histogram is computed using the histograms of these images. The intersection histogram is compared using Euclidian distance with each template in the database to find the closest matching meeting room. Employing an intersection histogram allows us to further eliminate the non-stationary objects in the meeting room and smooth out any background extraction errors. The use of multiple templates for each room provides a robust method for location identification. In our experiments, we successfully identified the 5 meeting rooms that we have in our research facility. Improvements to the algorithm might include using the size and the layout of the meeting room to address the issue of distinguishing rooms with similar colors.
Recorded meeting segments can be enhanced by further identifying and locating the meeting participants in the recorded segment. Locating meeting participants is a non-trivial problem, especially considering that a clean shot of the background is typically not available and participants are likely to have minimal motion. We address this problem by using sound localization to find the approximate location of each meeting participant. Then the precise location of each face is found by identifying the skin regions in this approximate location.
Skin pixels are detected in the normalized RG-space as discussed, for example, by Waibel, A., Bett, M., Metze, F., Ries, K., Schaaf, T., Schultz, T., Soltau, H., Yu, H., and Zechner, K., Advances in Automatic Meeting Record Creation and Access, Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, 597-600, 2001. Small holes in skin-colored regions can be removed by a morphological closing and then connected component analysis can be used to identify face region candidates. In environments with complex backgrounds, many objects, such as wood, clothes, and walls, may have colors similar to skin. Therefore, further analysis of the skin-colored regions, using techniques such as luminance variation and geometric feature analysis can be applied to further eliminate non-face regions. Some example face localization results are shown in
One of our goals is to find representative shots of the meeting attendees that can be included in the meeting description document. It is possible to extract many shots of a participant from the video sequence. However, generally not all of these shots are presentable. It is desirable to obtain frames where the individual is not occluded and facing the camera.
An example of obtaining a "best shot" from a video sequence is shown in
These shots are then evaluated to pick the best shot of a meeting participant. For example, the best shot 910 can be selected by evaluating the size of the face region relative to the size of the body region and/or the whole frame, evaluating the ratio of the face width and height, and evaluating the ratio of number of skin pixels detected in the best-fitted ellipse (to the face region) to the area of the best-fitted ellipse.
In a specific implementation, high resolution video capture devices can be used to produce high resolution images of the participants. This provides sufficient resolution in the captured video for the application of computer image analytical techniques to identify certain facial features, such as eye and mouth regions. The selection of the best attendee shots can be based on the detail of the facial features, such as the mouth and eyes, the distances between these facial features and their relative locations, the size and geometry of the face region, and so on. When the image of the face of a person looking straight at the camera is taken, these parameters tend to fall within certain ranges. These ranges can be the basis for computing templates to facilitate making a determination whether a person is looking straight at the camera.
In a face image of a meeting participant who is facing away from the camera, the various facial features metrics will deviate from the template metrics. For example, in a face image of a person whose face is turned to one side, the eye separation will be less than if the person had faced the camera squarely due the effect of the image of the eyes being projected onto a two dimensional surface. Thus, a best shot determination from among many "shots" (images) of a meeting participant's face can be made, first by identifying the facial features of interest for a given image. Next, metrics among the facial features are determined, such as shown in
The locations of the eye pupils can be detected using an IR emitter attached to the meeting recorder as an enhancement to the camera. (For example, J. Davis and S. Vaks in A Perceptual User Interface for Recognizing Head Gesture Acknowledgements, ACM Workshop on Perceptual User Interfaces, Orlando, Fla., Nov. 15-16, 2001, describe such a system.) Sound localization can then be combined with the IR-based eye pupil detection to eliminate false positives in pupil detection. Recall that sound localization data includes at each time index information indicating the direction of each sound source. The images each can be associated with a time index. Each image that is analyzed for pupil identification can be cross-referenced with the sound localization data based on the time index associated with the image in order to provide an additional decision point for pupil identification.
For example, suppose an image is being analyzed (using known computer image analysis algorithms) to identify pupils. Suppose further that a positive determination has been made, indicating the presence of pupils. On the one hand, one can simply assume the determination to be correct and continue on. On the other hand, the sound localization data can be used as an additional test to add some confidence to a positive determination. The time index associated with the image is used to access the sound localization data corresponding to that time index. If the sound localization data does not indicate that any sound originated from the direction of the camera at that time index, then such an indication can be interpreted to mean that the positive determination was a false positive, and the quest for eyeballs would continue. On the other hand, if the sound localization data indicated a sound originated from the direction of the camera at that time index, then the positive determination can be deemed to have been confirmed. Generally, employing the additional information of the IR data and the sound localization data can increase the reliability of identifying facial features, in addition to identifying pupils. Furthermore, it can be appreciated that an analogous process can also be used to reinforce the confidence of the sound localization results based on the pupil location data.
Pupil location metrics can be used to indicate the degree to which a person is facing directly at the camera and thus serve as a basis for determining the best shot. In an image of a person squarely facing the camera, the pupils 932 will be generally symmetric with respect to the face outline 934. For example, metrics such as pupil distances from the left and right side of the face outline typically will be symmetric. Thus, for example, the D1 and D3 measurements should be close, and the D2 and D4 measurements should be close. It can be appreciated that other such symmetry measurements can be used. When the head is turned, these measurements would no longer be symmetric due to the effect of projecting a three dimensional object onto a two dimensional surface.
Pupil and face (head) orientation can then be used in conjunction with pupil location to further facilitate determining best shot selection in the following manner. These metrics can indicate the degree of rotation of the head. For example, a person who has fallen asleep is not likely to be facing the camera directly, but rather will be facing the table. Thus, for the metrics shown in
The Muvie Client can be enhanced with additional navigational tools based on key frames 1012 and the transcript 1014. A slider window graphic 1016 can be provided which allows the user to scan up and down scales representing speaker transition activity, visual activity, and audio activity. As the slider is manipulated, a transcript window 1018 containing a transcription of the relevant conversation is displayed. A second slider window 1020 can be provided to allow the user to select from among the key frames.
Capability can also be provided for viewing slides, whiteboard images, meeting notes, both the perspective and panoramic meeting video, and audio tracks for speaker location, as well as visual significance measures and audio significance measures. A timeline 1004 is a vertically oriented graphic along which different channels of information can be displayed. The example shown in the figure shows the transcript, video key frames, and the results of speaker transition analysis, video activity analysis as well as audio activity analysis. In general, the Muvie Client enhanced in accordance with this aspect of the present invention, provides a tool for displaying the results of media analysis of the meeting recording. For example, analytical techniques for video such as those embodied in accordance with the invention, and including similar conventional techniques can be visually represented by the Muvie Client. Similarly, analytical techniques according to the present invention for audio and similar conventional techniques can be visualized by the Muvie Client in accordance with this aspect of the invention. Likewise for textual significance scores.
A visual representation of the speaker transitions channel is shown in 1004 in which each speaker can be marked with a unique color (identified in
<ID>0xD100FE </ID>
A SECTION tag typically marks a period of time (e.g., a one second period). For each SECTION we can have more than one SPEAKER. Each SPEAKER contains the values shown. All the data for a SECTION are shown at the specified TIME on the time line. The LOC tag determines the position of the speaker marking on the display; typically "1" is the leftmost location in the display bar. VALUE can be "0" or "1" indicating whether the person is speaking or not. Alternatively, VALUE can be a real number indicative of the strength of the measure of activity. The ID tag represents a particular speaker and can be used to indicate a color value associated with that speaker. However, we typically assign colors to speakers automatically since this gives the user some control over the visualization.
The Muvie client parses the XML format described above and creates a speaker data structure that can be used to create the display shown in
A representation for the visual activity channel can be graphically represented as a histogram along the time line 1004. It displays the visual activity scores for each unit of time (e.g., seconds, minutes) of a video sequence. The score is computed per Eqn. 2 and can be normalized for the display area. A slider window 1020 can be used to navigate the video based on the visual activity scores. The video and the rest of the metadata are automatically synchronized during the playback. The output of visual activity analysis is given to the Muvie Client in the following XML format:
The SECTION tag typically marks a one second period. However, it can be extended to longer periods of time. The STIME tag determines the start time and the ETIME tag determines the end time when a particular activity score is valid.
The Muvie client parses the XML format described above and creates a data structure that can be used to create a representation for visual activity analysis shown in
To plot this information on a user interface, as we did with the speaker transition information, a video channel is included in the timeline 1004 where we plot the visual activity as shown in
To map the data onto the user interface, we first determine the highest value represented in the data collection. We call this value max. Next we determine the width of the user interface which we call graphWidth (see
For example, if we have a <SECTION> object with a <TIME> value of 491 and a <VALUE> of 56, where graphWidth=50 and max=78, then, we have a new multiplier graph m=max/graphWidth or 1.56. We divide the <VALUE> by graph m to produce the width of the histogram bar for this <SECTION> object. Therefore, in the above example, we would plot the <SECTION> with <TIME>=491 and <VALUE>=56 at the vertical location (time) 491*.4367=214 with a width of 56/1.56=35. This process is conducted on each <SECTION> object to produce a timeline channel similar to the one shown in
A representation for the audio activity channel is shown in 1004 that displays the audio activity scores for each minute (can be in seconds) of a video sequence. This value is computed according to Eqn. 4 and scaled for the display area. It is displayed, navigated, and formatted in the same way as the visual activity data described above.
Completing the description of to
Using this interface, the user can browse a meeting by reading the description page, listening only to the speakers that he is interested in, looking at the high-motion parts, searching for keywords in the transcription, looking at the presentation slides and whiteboard images, and so on. In this way, hours of meetings can be browsed in much less time. The user interface can also support editing of the video, which enables the user to efficiently communicate meeting documents with others.
The meeting summaries can be generated based on individual or combinations of visual scores, audio scores, text importance scores, and importance score computed from slide presentations, whiteboard capture data, and notes in the manner discussed above. The user can specify which modalities to use when generating the summary. Using the time indices corresponding to the scores of the selected modality(ies), summary windows 1504 can be generated and displayed.
For example, the user can specify a one-minute long meeting summary based on audio and visual activity importance. Thus, the N highest visual scores and the M highest audio scores can be deemed to constitute a summary of the meeting. As discussed above, video skims corresponding to the time indices of these scores can be generated. However, rather than displaying video skims, the range of time indices corresponding to the generated video skims can be used to generate the summary windows 1504 shown in
In another example, the user may request a five-minute meeting summary based on slide importance. The slides that the presenter had spent the most time on might be considered important. Thus, the meeting summary might comprise one-minute meeting segments corresponding to five such slides. Again, the range of time indices corresponding to the presentation of those slides would be used to generate summary windows 1504.
As an alternative to displaying summary window graphics 1504, portions of text in the transcription window 1514 corresponding to the time indices can be highlighted. Similarly, corresponding keyframes 1512 can be highlighted. It can be appreciated that other similar forms of indicating the recorded meeting segments comprising the meeting summary are possible.
Selection of a summary window 1504 such as by clicking can cause a corresponding video skim to be played. Similarly, clicking on a highlighted portion of text or a highlighted keyframe can cause the corresponding video skim to be played. Alternatively, all the video skims comprising the meeting summary can be played sequentially by clicking on a "playback" button 1522. Navigation control through a video skim can be provided by "reverse" and "fast forward" buttons 1524, 1526 provided via the interface, allowing the user to watch only the highlighted parts, or skip to other sections of the meeting.
The interface shown in
Cited Patent | Filing date | Publication date | Applicant | Title |
US5132842 * | Jul 21, 1989 | Jul 21, 1992 | Rockwell International Corporation | Optical image transformation system |
US5664227 * | Oct 14, 1994 | Sep 2, 1997 | Carnegie Mellon University | System and method for skimming digital audio/video data |
US5754938 * | Oct 31, 1995 | May 19, 1998 | Herz; Frederick S. M. | Pseudonymous server for system for customized electronic identification of desirable objects |
US7298930 * | Nov 29, 2002 | Nov 20, 2007 | Ricoh Company, Ltd. | Multimodal access of meeting recordings |
US20030018475 * | Aug 30, 2002 | Jan 23, 2003 | International Business Machines Corporation | Method and apparatus for audio-visual speech detection and recognition |
US20090027618 * | Jul 28, 2008 | Jan 29, 2009 | Petra Perner | Method and Arrangement for Automatic Detection and Interpretation of the Iris Structure for Determining Conditions of a Person |
Reference | ||
1 | * | Witbrock, M., Hauptmann, A., "Speech Recognition for a Digital Video Library", Journal of the American Society for Information Science (JASIS), 49(7), 1998. |
Citing Patent | Filing date | Publication date | Applicant | Title |
US8027998 * | May 31, 2007 | Sep 27, 2011 | Fuji Xerox Co., Ltd. | Minutes production device, conference information management system and method, computer readable medium, and computer data signal |
US8214242 * | Apr 24, 2008 | Jul 3, 2012 | International Business Machines Corporation | Signaling correspondence between a meeting agenda and a meeting discussion |
US8396878 * | Sep 26, 2011 | Mar 12, 2013 | Limelight Networks, Inc. | Methods and systems for generating automated tags for video files |
US8660847 * | Sep 2, 2011 | Feb 25, 2014 | Microsoft Corporation | Integrated local and cloud based speech recognition |
US8799781 * | Oct 6, 2009 | Aug 5, 2014 | Sony Corporation | Information processing apparatus reproducing moving image and displaying thumbnails, and information processing method thereof |
US8806341 * | Dec 10, 2009 | Aug 12, 2014 | Hulu, LLC | Method and apparatus for navigating a media program via a histogram of popular segments |
US8811638 | Dec 1, 2011 | Aug 19, 2014 | Elwha Llc | Audible assistance |
US8903130 | May 9, 2012 | Dec 2, 2014 | Google Inc. | Virtual camera operator |
US8934652 | Dec 13, 2011 | Jan 13, 2015 | Elwha Llc | Visual presentation of speaker-related information |
US8966389 | Sep 21, 2007 | Feb 24, 2015 | Limelight Networks, Inc. | Visual interface for identifying positions of interest within a sequentially ordered information encoding |
US9015172 | Jun 15, 2012 | Apr 21, 2015 | Limelight Networks, Inc. | Method and subsystem for searching media content within a content-search service system |
US9026909 | May 25, 2011 | May 5, 2015 | Apple Inc. | Keyword list view |
US9037461 * | Jan 22, 2013 | May 19, 2015 | SpeakWrite, LLC | Methods and systems for dictation and transcription |
US9053096 | Dec 29, 2011 | Jun 9, 2015 | Elwha Llc | Language translation based on speaker-related information |
US9064152 | Feb 28, 2012 | Jun 23, 2015 | Elwha Llc | Vehicular threat detection based on image analysis |
US9070409 | Aug 4, 2014 | Jun 30, 2015 | Nathan Robert Yntema | System and method for visually representing a recorded audio meeting |
US9107012 | Jan 31, 2012 | Aug 11, 2015 | Elwha Llc | Vehicular threat detection based on audio signals |
US9159236 | Mar 29, 2012 | Oct 13, 2015 | Elwha Llc | Presentation of shared threat information in a transportation-related context |
US9240215 | Sep 30, 2011 | Jan 19, 2016 | Apple Inc. | Editing operations facilitated by metadata |
US9245254 * | Feb 15, 2012 | Jan 26, 2016 | Elwha Llc | Enhanced voice conferencing with history, language translation and identification |
US9361130 * | May 3, 2010 | Jun 7, 2016 | Apple Inc. | Systems, methods, and computer program products providing an integrated user interface for reading content |
US9368028 | Mar 20, 2012 | Jun 14, 2016 | Microsoft Technology Licensing, Llc | Determining threats based on information from road-based devices in a transportation-related context |
US9412392 | Jan 27, 2014 | Aug 9, 2016 | Apple Inc. | Electronic devices with voice command and contextual data processing capabilities |
US9536564 | Feb 20, 2012 | Jan 3, 2017 | Apple Inc. | Role-facilitated editing operations |
US9548050 | Jun 9, 2012 | Jan 17, 2017 | Apple Inc. | Intelligent automated assistant |
US9582608 | Jun 6, 2014 | Feb 28, 2017 | Apple Inc. | Unified ranking with entropy-weighted information for phrase-based semantic auto-completion |
US20080077583 * | Sep 21, 2007 | Mar 27, 2008 | Pluggd Inc. | Visual interface for identifying positions of interest within a sequentially ordered information encoding |
US20080077869 * | Jul 27, 2007 | Mar 27, 2008 | Kabushiki Kaisha Toshiba | Conference supporting apparatus, method, and computer program product |
US20080133600 * | May 31, 2007 | Jun 5, 2008 | Fuji Xerox Co., Ltd. | Minutes production device, conference information management system and method, computer readable medium, and computer data signal |
US20100088646 * | Oct 6, 2009 | Apr 8, 2010 | Yuichi Nishimori | Information processing apparatus reproducing moving image and displaying thumbnails, and information processing method thereof |
US20100332981 * | Jun 30, 2009 | Dec 30, 2010 | Daniel Lipton | Providing Media Settings Discovery in a Media Processing Application |
US20110145726 * | Dec 10, 2009 | Jun 16, 2011 | Hulu Llc | Method and apparatus for navigating a media program via a histogram of popular segments |
US20120221365 * | Feb 22, 2012 | Aug 30, 2012 | Hiroshi Maeda | Information processing system, apparatus, method, storage medium |
US20120254745 * | May 3, 2010 | Oct 4, 2012 | Zumobi, Inc. | Systems, Methods, and Computer Program Products Providing an Integrated User Interface for Reading Content |
US20120278337 * | Sep 26, 2011 | Nov 1, 2012 | Limelight Networks, Inc. | Methods and systems for generating automated tags for video files |
US20130060571 * | Sep 2, 2011 | Mar 7, 2013 | Microsoft Corporation | Integrated local and cloud based speech recognition |
US20130073964 * | Feb 20, 2012 | Mar 21, 2013 | Brian Meaney | Outputting media presentations using roles assigned to content |
US20130110508 * | Sep 5, 2012 | May 2, 2013 | Samsung Electronics Co., Ltd. | Electronic device and control method thereof |
US20130113804 * | Nov 6, 2011 | May 9, 2013 | Ahmet Mufit Ferman | Methods, Systems and Apparatus for Summarizing a Meeting |
US20130144603 * | Feb 15, 2012 | Jun 6, 2013 | Richard T. Lord | Enhanced voice conferencing with history |
US20130204618 * | Jan 22, 2013 | Aug 8, 2013 | SpeakWrite, LLC | Methods and Systems for Dictation and Transcription |
U.S. Classification | 382/305, 715/719, 715/716, 715/727 |
International Classification | G06K9/54, G06K9/60 |
Cooperative Classification | Y10S707/99931, G11B27/28, G11B27/34, G11B27/034, G06K9/00711 |
European Classification | G06K9/00V3 |

subset: commoncrawl


text:
| LinkBack | Thread Tools | Display Modes |
| ||||
| ||||
ATLANTA -- Welcome to the club, Aroldis Chapman, Brian Wilson and Darren Oliver. In consecutive Division Series games Friday and Saturday, the three relievers joined the legions of pitchers who have blown a postseason save since Mariano Rivera blew his last one six years ago. The count is now 36 pitchers since Rivera spit one up. More... |


text:
Reviewed By | Date | Rating | Strength | Flavoring | Taste | Room Note | |
Lonesomepiper (3) | Mild to Medium | Mild | Medium to Full | Pleasant |
Like Albfneto said, this is a good blend. Even more if you thing you're going to get the usual strong 'chocolate' aroma typical in some OTC aromatics. Not here, as it is only cased. And in a good way. No bitter taste, very mild casing, a good sweetness from the virginia, easy to smoke and enjoy, (I let mine in a not so tight jar for a month to dry a little.) I gave some to a friend of mine who love English Mixtures and he loved it! He even took my little jar and told me he will buy another pouch for me!! Makes me thing of Edward G. Robinson's from Sutliff. In which this is a very underrated blend. If it was offered with a 'fancy' name and a round tin, many would swear by it!
Pipe Used: Bertoldi Maestro
Age When Smoked: New tobacco - aged for a month only
Purchased From: Tobacco shop in the Mercado Central in Goiania, GO, Brazil
Nobody has rated this review yet.
Reviewed By | Date | Rating | Strength | Flavoring | Taste | Room Note | |
albfneto (183) | Mild | Mild to Medium | Mild to Medium | Very Pleasant |
As the Strawberry Blend, this is good. Between the best Candido Giovanella. only the Whisky Blend surpasses this,
Nobody has rated this review yet.


text:
November 10, 2010
"Using mobile-phone text messages to remind HIV patients to take their dose of life-saving medications can give a major boost to drug adherence, according to an innovative trial in Kenya unveiled on Tuesday," Agence France-Presse reports.
For the study, which was published online in the Lancet Wednesday, researchers describe how "[b]etween May 2007 and October 2009, 538 patients [initiating antiretroviral therapy (ART)] were enrolled in the WelTel Kenya1 study from three clinics that provided care for HIV/AIDS patients -- one in a low-income section of Nairobi, another in a higher-income section of the city, and a third in a rural district. Half of the patients were randomly selected to receive text message support, while the others did not," according to a University of British Columbia press release (11/9).
"Patients in the intervention group received weekly SMS messages from a clinic nurse" with "the slogan 'Mambo?' ... which is Kiswahili for 'How are you?'," the study authors write. "The health workers used multiple recipient (bulk) messaging functions to improve efficiency. Patients in the intervention group were instructed to respond within 48 h that either they were doing well ('Sawa') or that they had a problem ('Shida'). The clinician then called patients who said they had a problem or who failed to respond within 2 days," they report (Lester et al., 11/10).
"It's not actually reminders, per se, it's actually the support that they seek, and timely triggers to be able to report on any problems that they have," the University of British Columbia's Richard Lester, lead author of the study, explained, during a presentation of the findings at the mHealth Alliance Summit in Washington, D.C., the Canadian Press/Winnipeg Free Press reports. "It's a weekly check-in, and it provides them the chance to report on any problems they have with their medications very early, and then the nurse or clinical officer would actually call them back and sort out those problems and triage them," Lester added (Tobin, 11/9).
"About three percent of participants in the text messaging group reported a need for followup," leading "the researchers [to] estimat[e] one nurse could potentially manage 1,000 patients by text messaging and expect to call 33 patients per week" CBC News reports. (11/9).
With the cost of each SMS "around five U.S. cents," AFP adds "the SMS system could be a sure-fire winner compared to personal visits by a nurse, the researchers say. It could be less expensive just measured on travel costs alone" (11/9).
"Overall, this study has implications for policy makers and global funders of ART programmes," the study authors report in the Lancet. "First, this is one of the first adherence interventions to confer a reduction in virologic failures. ART needs to be taken lifelong, thus optimal adherence is crucial to the prevention of antiretroviral drug resistance. Instances of drug resistance make future treatment options more challenging and progressively more expensive to deliver. Additionally, reducing viral replication through ART can decrease transmission of HIV-1 to new partners and thus can play a preventive role at the population level to reduce the number of new infections," they conclude (11/10).
In an accompanying Lancet Comment, Benjamin Chi of the Centre for Infectious Disease Research in Zambia and Jeffrey Stringer of the University of Alabama School of Medicine write, "As policy makers consider bringing the SMS intervention to scale -- which we think they should -- some questions remain," such as whether or not the findings could be replicated in other settings and the potential cost associated with such intervention (11/10).
Leaders Address mHealth Summit
In a keynote address at the mHealth Summit on Tuesday Bill Gates, co-chair of the Bill & Melinda Gates Foundation, emphasized the potential for mobile technology to "improve global health with cheap diagnostic tools, patient reminders and making immunization programs more efficient," AFP reports in a separate article (11/9).
"'The mobile phone is pretty interesting for lots of things,' Gates said in his keynote address at the mobile health event," AFP/TechRadar reports. "'There's a whole lot of opportunities. I think we have to approach these things with some humility though,' added Gates, noting that much of the developing world still has no internet or data connections" (Hartley, 11/10).
AFP writes that Gates noted mobile technology's ability to provide a link between trained health care professionals and patients in limited resourced clinics as well as other benefits of the technology for making improvements to TB diagnostics. "I do think there's absolutely a role (for mobile technology to impact global health) but I think we have to hold ourselves to some pretty tough metrics to see if it's really making a difference or not," Gates said (11/9).
allAfrica.com, also reporting on the mHealth Summit, writes of why health experts believe mobile phones present an opportunity to improve health outcomes in developing countries.
"The fastest growing cell phone markets, in fact, are in the developing countries where the disease burdens are also the highest. There are five billion subscribers today, almost 70 percent of them in the developing world," said Kathy Calvin, CEO of the United Nations Foundation, according to the news service. "We believe that through wireless networks we can connect patients, families and practitioners with a speed and breadth never before possible. We have the ability to get the right information into the hands of the people who need it, when and where they need it -- messages, reminders, checklists, access to information, calls for emergency help in a difficult birth, are all improved with the use of cell and mobile technology," Calvin said.
The article outlines several topics to be addressed during the mHealth Summit -- including what the news service refers to as "the first organizing meeting of the maternal mHealth initiative" -- and names several keynote speakers at the summit, including Aneesh Chopra, White House chief technology officer; Ted Turner, chairman of the U.N. Foundation; and Judith Rodin, president of the Rockefeller Foundation (Shiner, 11/10).
Back to other news for November 2010
This information was reprinted from kff.org with permission from the Henry J. Kaiser Family Foundation. You can view the entire Kaiser Daily Global Health Policy Report, search the archives, and sign up for email delivery. © Henry J. Kaiser Family Foundation. All rights reserved.
No comments have been made.
The content on this page is free of advertiser influence and was produced by our editorial team. See our content and advertising policies.


text:
This book is about the world of parenting and parenthood in the Georgian era. It navigates recent 'turns' towards emotions, subjectivity, memory, the body and materiality. This approach reveals the profound emotions provoked by motherhood and fatherhood and the labour and hard work it entailed. Such parental investment meant that the experience was fundamental to the forging of national, family and personal identities. Society called upon parents to transmit prized values across generations and this study explores how this was achieved. All in all, raising children needed more than two parents ... More
Keywords: parenting, parenthood, motherhood, fatherhood, emotions, memory, family identity, personal identity, generations, kinship
Print publication date: 2012 | Print ISBN-13: 9780199565191 |
Published to Oxford Scholarship Online: May 2012 | DOI:10.1093/acprof:oso/9780199565191.001.0001 |


text:
@Jehzlau – I see, all the best to the contestants. I'm sure the winner will be very happy to find out he/she has won. :D
Hi everyone! It's good to be back after being away from my blog for a week. For those who don't know, my family and I went on a road trip from California to Maryland which is about 2,600+ miles, 40+ hours of driving and took us 5 days & 4 nights (including stopovers). My apologies for the lack of updates. I wasn't able to post updates because I didn't have any Internet connection and I couldn't login to my WordPress dashboard on my iPhone because the latest update of the WordPress for iOS (iPhone/iPad) was broken.
I also wasn't able to publish last week's edition of the Weekend Roundup because I was very busy packing stuff and getting ready for our trip. I planned on scheduling posts for last week but wasn't able to prepare any drafts/posts because of the busy schedule. I was also planning on posting a few guest posts from blogger friends but that too didn't work out.
I'll do my best to make it up to you guys with several updates in the coming days. I'll also be posting a blog contest/giveaway so watch out for it. Hope you folks enjoy this week's edition of the Weekend Roundup! Btw, this week's edition is kinda "special" because it is the 100th edition of the Weekend Roundup.
Pinoy Blogs
JaypeeOnline Weekly Recap
If you have any questions, comments, suggestions or want your article or find an interesting story that you want to be featured in the next Weekend Roundup, feel free to leave a comment or send me a message via the contact page.
hopefully this week.. medyo mahirap pumili. O_O
good to se you back , i didnt see my comments pass moderation for a long time , thought you might be off for sometime … I saw the little update there to wp app on my ipod. but as im using a JB'kn ipod , i dont login to my admin accnts from the there … who knows , there maybe a keylogger working inside
Heard about 1800Goog411 service being shut down. Was really disappointed as I thought this service would really be helpful to common people. Recently I tried a new toll free service 1800-500-0000 by Justdial. I am completely amazed by this human assisted service. Try it out…
bai..great to have you back and congrats on the 100th post of weekly round up. Have a great week.
That is one long trip! This is my first visit to your site, but I love the weekend round up posts. Thanks for saving me the time looking around the net for these resources.
glad to see you back! wooot! thanks for linking my 150k led video board ad contest.. hehe :D


text:
Thursday, January 3, 2013
I found the most perfect mug! It has the cutest print I've ever seen and it's also in the colors I'm using for my new place! I can totally see myself drinking my morning tea from it. Also, it looks like it's made for my blog, doesn't it?
11 comments:
So sweet...it is perfect for you...so pretty!! I hope you have a great weekend xx
The Dainty Dolls House
Subscribe to:
Post Comments (Atom)


text:
Tuesday, November 1, 2011
Matt Kemp @ A Day of Champions at Sports Museum of L.A. this Sunday
Remember when Kirk Gibson was selling all of his World Series items last year? And I was invited to the press conference at "The Sports Museum of Los Angeles". If not, click here.
That museum is amazing!
The museum is closed to the public but it will be open for fans this Sunday. Several sports athletes will be on hand.
Tickets priced at $500 for a family four-pack; individual tickets are available – adults $150, children $100; sponsorship packages begin at $5,000. For event tickets and sponsorship opportunities, please call Levy, Pazanti & Associates at (310) 201-5033.
From The Sports Museum of Los Angeles
* * *
Yahoo! Sports presents A Day of Champions, Sunday, November 6, 2011, at the Sports Museum of Los Angeles benefiting The Bogart Pediatric Cancer Research Program. The event honors WME's Adam Venit and his wife, designer and philanthropist Trina Venit with the 2011 Children's Choice Award. Craig Ross and Ross Levinsohn chair.
The unique, family-oriented sports themed day-long event includes open access to the largest private collection of sports memorabilia and collectibles in the world. Guests will meet and compete with some of the biggest names in professional, professional, Olympic and extreme sports including Matt Kemp (LA Dodgers), Eric Dickerson (NFL Hall of Famer), Matt Barnes (Lakers), Al-Farouq Amiru (LA Clippers), Dave Stewart (MLB, World Series MVP), Baron Davis (Cleveland Cavaliers), Spencer Haywood (former NY Knick), Casey Bond (ormer SF Giants), Cade McNown (former Chicago Bear), Carmelita Jeter (IAAF World Champion), Rick Thorne (BMX Superstar), Josh Hansen (Supercross Pro), Ashley Force Hood (NHRA Funny Car driver), Jeremy "Twitch" Stenberg (Freestyle Motocross 10-time X Games medalist), Ronnie Faisst (Freestyle Motocross 2011 X Games Gold medalist) and celebrity appearances by Russell Brand, Billy Bob Thorton, Jon Cryer, James Marsden, Chad Michael Murray, Milo Ventimiglia, Oliver Hudson, Robert Knepper and more. A barbecue, special demonstrations and activities will allow guests to challenge athletes to basketball, football, soccer and boxing. Batting cages, speed pitch, miniature golf, sumo wrestling, a Velcro wall and rock climbing round out the event.
The 32,000 square foot Sports Museum of Los Angeles contains 30 galleries showcasing more than 10,000 prized pieces. Collected during a 25-year period by founder and CEO Gary Cypres, the permanent exhibits feature items dating to the 19th Century and include one-of-a-kind pieces from football, basketball, baseball, golf, tennis, boxing, biking, soccer and other sports.
The Bogart Pediatric Cancer Research Program raises vital funds to support early stage pediatric cancer research at the Bogart laboratories located at Childrens Hospital Los Angeles. The Bogart Program is dedicated to supporting "bench to bedside" research to find cures and treatments for these diseases and to enhancing the quality of life of the children who survive them. Please visit www.bogartfoundation.org.
Also visit http://www.sportsmuseumla.com/index.html.
Subscribe to:
Post Comments (Atom)


text:
[07/01/2007] As you can see, our html template has received a few minor upgrades. Please download the new template if you do your own html. Here are the changes:
The text template has also been updated, but the only change is the addition of platform.
Note: for Platform, please select the platform that you played the game on. This applies to both text and html templates.
Finally, a welcome to Cyllya who writes their first review this week.
Derek 'Roku' Cavin tweaks stuff
· Useful Stuff · Submission Guide · Review FAQs · Scoring Definitions · Reviewless Games · Challenges Page · Chat With Us
Review Crew


text:
2nd Door Of Our Advent Calendar – Support in WordPress for rel="canonical"
WordPress 2.9 will support the attribute rel
and his value canonical
, you can also read about it on an older post how to integrate the values and what's about it. Therefore you don't have to paste the HTML explicitly in your theme.
In previous versions of WordPress 2.9, the intergration is easy to do:
<?php if ( is_singular() ) echo '<link rel="canonical" href="' . get_permalink() . '" />'; ?>
Putting it in the header.php of the theme is the easiest way to have the link-tag in the head
of your frontend.
Since WordPress 2.9 it won't be necessary because WordPress set with the help of the default filter, see wp-includes/default-filters.php
, the link
-tag to the hook wp_head
add_action( 'wp_head', 'rel_canonical' );
Thereby it calls the function rel_canonical()
, which simply writes the HTML and passes the link of the article. Alternatively you can disable the filter and you can use it yourself.
remove_action( 'wp_head', 'rel_canonical' ); // to delete in head


text:
Note: Images may show upgrades
Be the first to review this product
Availability: In stock
Carolon Company Health Support Vascular Full Thigh-Length Hosiery Regular Size B, Beige, Sheer Fabric, Closed Toe, Unisex, 20 to 30 mmHg Compression, with Superior Silicon Non-slip Band, Latex-free
Please call us for specific details.
Please call us for specific details
Only registered users can write reviews. Please, log in or register


text:
What are all the weird ranks and pics about example Prince Imdol: Swimming with the Fishes
and wunztwice:
Sir Anotherbrickinthewall
Did I miss something?
FullNelson wrote:Ya but mines not weird right... RIGHT.....
Voran_the_Scholar wrote:To be quite honest, I'm utterly amazed Sava hasn't come after me yet. You should have seen the chaos I caused! It was glorious...glorious infamy.
FullNelson wrote:What wheres everyone going?
Voran_the_Scholar wrote: wunztwice? I think the same reason though I'm not quite sure about that.
sir dano wrote:Voran_the_Scholar wrote:To be quite honest, I'm utterly amazed Sava hasn't come after me yet. You should have seen the chaos I caused! It was glorious...glorious infamy.
You sure about that Voran_The_Pooper_Scooper? I seem to remember something about a "Total Noob".
wunztwice wrote:Yeah, me either... At least it's better than the three I had right around April 1st! ("Bong farmer," "Illegitimate son of a bong farmer," and one more I can't remember off-hand)
Voran_the_Scholar wrote:That was not me. If I remember correctly, that was Danielas.
Lamanda2 wrote:I was also curious about some of the newer titles people were getting, along with the silly little animations, which distract me quite easily when browsing the Forums (I'm just easily amused..).
I don't think I've had a custom rank to date, or at least I don't remember. But I've had it bad enough, I've already gone through the ranks; Freeman, my previous rank of Gentleman, and now this current rank of Man-at-Arms.. Sheesh! I need to be cut some slack already.
At least post 1000 is slowly creeping it's way here.
Users browsing this forum: No registered users and 2 guests