Software Technology for “Rapid analysis of medical imaging data”

Medical Device – Andrew V. Barger, Maestro Devices LLC

Abstract for “Rapid analysis of medical imaging data”

“Systems are available that allow viewing image data using a system that is strictly linked with at least one monitor and an ancillary points-and-click device. This allows for quick image analysis through navigation and analysis in less time and with less repetitive motions.

Background for “Rapid analysis of medical imaging data”

“Field of Invention”

The teachings concern a navigation system that allows you to view an image data stack faster and with less repetition, such as a data-stack of medical images.

“Description of Related Art”

Radiologists use cutting-edge imaging technology in order to examine organs and tissue to diagnose injuries or illnesses and begin treatment. Radiologists used film Xrays in the beginning, but today radiologists have many imaging tools available to them, including X-ray radiography (CT), magnetic resonance imaging, positron emission tomography, and nuclear imaging. Digital technology has made it possible to transmit image data via the internet. Modern radiologists can now practice anywhere there is internet access. Telemedicine is a valuable tool for society as it allows skilled, urgent consultations and collaborations even after hours. Problems can arise in the provision of such services. The modern radiologicist is often required to work for long periods of time at a traditional computer station. This allows him or her to efficiently analyze images and deliver diagnoses using traditional computer tools.

The problem is made worse by the fact that digital imaging has made it possible to quickly produce and send numerous medical images to radiologists, faster than ever before. A data-stack might have contained only axial images 20 or so years ago, but the data-stack can now be reconstructed using multiple imaging planes, multiple reconstruction algorithms or three-dimensional models. A radiologist might have presented 20-30 images per case 20 years ago. However, now the radiologist could be presented with 2000-3000 images. This slow-step affects the radiologist’s ability to use traditional computer tools, which still include the point and click mouse, as a navigation device. It makes it more difficult and time-consuming for him or her to sort, select and view the growing number of images. The current limitations of navigation devices make it difficult for the radiologist to fulfill the job requirements, including providing consistent and reproducible analyses of large data stacks as quickly and accurately as possible.

These problems related to handling and viewing data-stacks have been solved by systems that can format, store and distribute data in a universal way. Picture archiving systems and communication systems (PACS) have made it possible to store and retrieve image data in various formats (imaging modes). This allows images and reports to be sent digitally. It also eliminates the need to file, retrieve or transport film jackets. PACS is made up of four main components. PACS has been able to reduce the physical and time limitations associated with traditional film-based image retrieval and distribution. However, it has not addressed the inefficiencies at the radiologist?s workstation. For example, a radiologist who views thousands of images per day uses a computer system very similar to one used by an ordinary user. However, they are not subject to the same production requirements and time constraints. The system will be used by both the radiologist as well as the average user. It includes a processor, an image database, a graphical user interface to view the images and, most importantly, the traditional point and click mouse for selecting and pointing-to the image data. This allows for the viewing and interpretation of images by subgroups, groups, and individually.

The inefficiencies at the traditional radiology workstation are a source of significant problems. It is possible to reduce the time required to interpret and to concentrate on the benefits for all. Reducing the use of the traditional “point-and-click” method. Steps inherent in the standard mouse? Control will reduce redundancies and inefficiencies at radiologist’s stations, which in turn will result in fewer repetitive stress injuries for modern radiologists. A study on repetitive stress injuries among radiologists in a PACS-based radiology section showed that 73 respondents responded to the survey (a 68% response rate). Boiselle, P. M. J. Am Coll Radiol. 5(8):919-23 (2008). Most respondents reported that they worked more than eight hours per day on a personal computer or PACS system monitor. Recurrent stress symptoms were reported in 58% of the respondents. 38% reported prior diagnoses of repetitive strain syndrome. See Id. Abstract

“The teachings herein will improve the radiologists’ workstation and help them overcome human limitations that are associated with traditional methods of navigating through the data stack. The images. A modern workstation will be appreciated by someone with skill. It (i) reduces time needed to review a case. (ii). Allows the radioologist to concentrate more on the act and not the navigation of data. (iii). Reduces repetitive stress injuries caused by multiple movements required to sort, navigate, select, view, and interpret data from images.

Image analysis systems components, devices and methods are available, including an image navigation system, which allows for quick, efficient viewing of an image stack. Systems, components, devices, methods, and systems are designed to reduce time and repetitive motions when viewing the image-stack of data. A navigation system allows for the faster and more efficient viewing of an image stack using less effort and less repetitive motions. For example, the navigation device can contain: (i) an image subset selector that allows you to select an image subset from the image data stack; (ii) a scrolling selector that allows you to scroll through the subset of discrete images as a data series. A graphical user interface is also possible to be connected to the processor in order to view the plurality set of discrete images. These systems, components, devices and methods are designed to solve the problem of providing a rapid, efficient way to view a data-stack with images. They can be implemented, for instance, “point-free?”. “Steps and less repetitive motions.”

The teachings concern a navigation system that allows you to view an image stack faster and with less repetition, such as one of the data stacks of medical images. The navigation devices in the systems, components and devices described herein can be configured to improve efficiency and movement in the viewing of the data stack of images. For example, the navigation device can have: (i) an Indexing State Selector to select a desired subset from the independently viewable subsets; (ii) A Scrolling State Selector to scroll through the selected subset as a data sequence of the discrete pictures. As with traditional computers, one or more graphic user interfaces can be connected to the processor for, for example, viewing a plurality of discrete sets. These systems, components, devices and methods allow you to view a data-stack with images in a more efficient way by using ‘point-free’ technology. Steps and less repetitive motions.”

The systems may include a processor, a database connected to it and on non-transitory computers readable storage media for storing data. A navigation engine is connected to a processor and on non-transitory computers readable storage media for parsing the plurality set of discrete pictures into independent subsets. An indexing module connected to processor and on non-transitory storage medium for pointless indexing each of independently viewable parts of the images. The scrolling module allows for reviewing each subset of discretes.

The system can be modified to allow for the following: “In addition to allowing users to view images quickly and efficiently, it can also include the ability to alter images, enhance images and combine images, average images and subtract images from others, change the image format and other functions.” The systems may also include a transformation module that can be connected to the processor as well as a non-transitory computer-readable storage medium. This allows the user to transform the image data into modified sets of images.

“Likewise, users can select images from within a data stack using subjective user selections, software communication links, image filtering algorithms, other known methods, default image criteria and the like. This allows for the selection of subsets from the data-stack. The system can then parse images into a desired subset that the user selects. This functionality can be provided by any engine or module described herein or built into a dedicated module. However, certain embodiments include a transformation module that provides this function. The system can also include an image enhancement function. The transformation module can be set up to alter the desired subset of images by image enhancement.

“One of the skillful will also recognize the value of communicating with another user or group. The second user could be a second doctor or another professional who can help with the interpretation or analysis of a medical picture or medical data-stack. The system may also include a data exchange module that allows users to send or receive data with each other. A state selector can be included in the navigation device that controls sending and receiving with the second user.

“One with skill will see that scrolling too fast or overlooking images can be a problem when scrolling through a data-stack. The teachings include systems and methods that use a dwell module to control the speed at which images are scrolled through in a data-stack. The dwell module can also be used to control the speed of scrolling.

“One with skill will also recognize that video streams of medical data may be useful, for example, in diagnosing or understanding a disease. The image enhancement systems described herein may include the creation, storage, display, or manipulation of a video stream using a selected subset of images. Scroll module navigation can also allow for manipulation of video streams. The systems and methods described herein may include a video engine that produces and/or displays a video stream and/or allows for the navigation of the video stream of images within the data-stack. In some embodiments, the video engine may include a frame graber to select an image from the video stream.

An individual of sufficient skill will be able to link specific image review steps with dictation while images are being reviewed. The systems and methods described herein may include a module that allows for prompting, receiving, or otherwise processing data-stacks based on criteria, such as dictation templates. For example, the user may input their analysis via voice or text.

“One with skill will also be able to recognize that an analysis can be done on the data-stack images using a systematic analysis. This can either be a default or customized systematic analysis script. Both can have script?pathways. The system will follow the user’s previous responses or responses. The user may be prompted with either a default or custom analysis script when the images are being reviewed. The systems and methods described herein may include an analysis module that prompts automatically or upon request. This allows the user to analyze one or more images. The dictation module, for example, can link one or more images in the data-stack to a default list of queries that are selected from a group of queries based on imaging tech, a disease or disorder state, region of body, standard of care or any combination thereof. In some cases, the dictation module may link one or more images from the data stack to a custom list of queries. This can be done using a group that includes queries based on a physician or practice group preference, a specific patient, variations in a disease state, a set or combination of symptoms or a combination of these.

“The ?point-free? “The?point-free? method is much more efficient than state-of the-art methods. It involves fewer repetitive actions and steps. Some embodiments allow for the user to quickly and efficiently view a data stack through a graphical interface. This can include: storing a dataset on a processor that is connected to a navigator engine and on non-transitory computers readable storage media; indexing each subset of the discrete pictures for an independent selection with an indexing module connected to both the processor as well as on a computer readable storage media to enable point-free indexing; scrolling through each subset of the discrete photos with a navigator Point-free selection can be used to select a subset of the independently viewable subsets using an indexing state chooser. The desired subset is indexed for an efficient selection with no point-free activation of that state selector. Scrolling through the subset of discrete images as a data series with a scrolling selector allows you to scroll through the subset. A graphical user interface can be used to view the images within the data-stack. After completion of viewing, the user can provide analysis of the images.

The systems, components and devices described herein are more efficient than current state-of the-art methods. “One skilled person will be able to appreciate the improved efficiency of the systems, components, devices, or methods. In some embodiments, selecting can be completed in less than 10 minutes.

“The teachings herein are based on the medical field as a platform for discussing the advantages of the presented systems and methods. The teachings herein can be used to view any image data-stack. Some embodiments include radiographs in the medical image data. Some embodiments include magnetic resonance imaging in the medical image data. Some embodiments include sonographs, CT and PET images in the medical data. The teachings provide a method for viewing a data-stack containing medical images quickly and efficiently via a graphical user interface. These systems may include a processor, a database connected to it and on non-transitory computers readable storage media for medical image data. A navigation engine is connected to this processor and to a nontransitory storage medium for indexing each discrete subset of the images. A scrolling module can be connected to and connected to a nontransitory storage medium for assembly of each discrete subset of the images as a data sequence of the images. The scrolling module allows for the user to scroll through each discretes

“To allow for independent selection and mapping discrete images to facilitate a highly efficient viewing/retrieval, the method may include each image having its own identification means that can be linked to provide a?linking device? The navigation device can be used to link the images and sets, subsets and discrete images, allowing for quick and efficient indexing. The means of identifying a discrete or set image can include any parameter that can help in filtering the images or parsing them. The parsing and filtering of images can be done using a variety criteria such as the location of the image on the screen, type of imaging technology, body part or objects imaged, position of the image within that body part or object, and time imaged. Also, the subject imaged may include details about the subject such as name, age and sex, gender, genetic markers, or other correlating diagnostics. The indexing step may also include additional indexing/identification of each discrete image for an independent selection, such as one image or a custom-designed group of images. Some embodiments provide images with an alphanumeric identifier or bar code or another known method of identification. Some embodiments provide enough variation or permutations for each image to ensure that each image has a unique identifier. Each image or subset of images can be unique for any time period, including 1 month, 6 years, 2 years and 5 years. The image database can be a master image storage system accessible via downstream computing systems using a computer network, such as the intranet or internet. The indexing state selector can also be modified to allow for a quick, efficient, one-click indexing of sets, subsets and discrete pictures. A scrolling state selector allows the user to scroll through the sets and subsets to discrete images. This reduces repetitive motions.

“In some embodiments, a scrolling platter is included with a series one-click buttons that correspond to specific locations in a data stack. The navigation device may include a plurality scrolling platters that can each be set to correspond with a particular set of discrete images. Additionally, there are a number of one-click buttons that each correspond to specific locations in the data stack, which can all be pre-specified by the user. In some embodiments, the navigation devices include a scrolling platter, a series of one click buttons, and a second scrolling plate, which correspond to a second graphic user interface.

“One skilled person will recognize that repetitive point-and click motions can be laborious. The teachings herein improve efficiency through the selection of sets, subsets and discrete images. This results in lower repetitions and the elimination of the need for point-and?click on the graphical user interface. Particularly useful in situations where the user switches between multiple data-stacks is the ability of the scrolling selectionor (or plurality of scrolling chooseors) to keep an association with a particular subset of images. This can reduce the repetitive motions needed to review the images.

A navigation system is designed to allow for quick, efficient viewing of an image stack via a graphical user interface. This navigation system can be used for images that are not medically related. The navigation system is optimized for viewing image data stacks in less time and with fewer repetitive motions. The navigation devices in the systems, components and devices described herein can be configured to reduce time and repetitive movements when viewing the data-stack. For example, the navigation device can have: (i) an Indexing State Selector to select a desired subset from the independently viewable subsets; (ii) A Scrolling State Selector to scroll through the selected subset as a data sequence of the discrete pictures. A graphical user interface is also possible to be connected to the processor in order to view the plurality set of discrete images. These systems, components, devices and methods provide a quick, efficient way to view a data-stack with images. They can be implemented, for example, “point-free?”. Steps and less repetitive motions.”

“FIG. “FIG. Computer system 100 can be a traditional computer system that includes a computer, I/O devices 150 and a display device. The computer 105 may include a processor 120 and a communications interface125. It also includes memory 130, non-volatile storage 140, I/O controller145, and display controller 135. The I/O devices 150 or 155 may be connected to the computer system 100.

“The computer 105 interfaces with external systems through the communications connector 125. This may include a modem, network interface, or both. The communications interface 125 may be considered part of either the computer system 100, or the computer 105. The communications interface 125 could be an analog modem or isdn modem. It can also include a cable modem. ?direct PC? ), or other interfaces that allow the computer system 100 and other systems to be connected. This interface may be used to communicate with a cell phone or another device that receives information in the same way. It can also include a cabled interface to connect with a personal computer. Two-way pagers are an example of a communications interface 125. It is usually a radio interface to communicate with a data transmission network, but it may also include a cabled interface or cradled interface. The communications interface 125 is typically a cabled or cradled interface. It may also include a radio interface such as a BLUETOOTH, 802.11, or cellular radio interface.

“The processor 120 could be, for instance, any suitable processor such as a conventional processor such as an Intel Pentium or Motorola power processor microprocessor, a Texas Instruments electronic signal processor or a combination thereof. A bus connects the memory 130 to the processor 120. The memory 130 may be dynamic random access memory, (DRAM), or static RAM (SRAM). The bus connects the processor 120 to memory 130 and also to non-volatile storage 140 to display controller 135 and I/O controller 145.

“The I/O device 150 can include a keyboard and disk drives, printers, scanners, and other input-output devices such as a mouse or other pointer device. The teachings include a navigation device with an indexing state selector or scrolling state selector. The display controller 135 can control the display on the display device 55 in a conventional way. It could be a cathode-ray tube (CRT), liquid crystal display (LCD), and light-emitting diode (LED) display. Both the I/O controller 140 and 135 can be used with well-known technology. They may even be combined.

“The non-volatile storage 140 can be either a FLASH memory, read-only memory or a combination of both. Although magnetic hard drives, optical disks and other forms of large-data storage may be used in certain embodiments, the form factors of such devices usually prevent them from being installed as permanent components in some devices. A mass storage device installed on another computer can be used with limited storage. This data is often written into memory 130 by direct memory access during the execution of software on the computer 105. A skilled person in the art will recognize the terms “machine-readable medium?” Or?computer-readable media? Any type of storage device that can be accessed by the processor 120. It also includes a carrier wave that encodes information. Non-volatile storage 140 can store objects, methods, inline caches and cache states, as well as other object-oriented components. It also allows for the writing of data information into memory 130, during execution of an object-oriented program.

“The computer system 100 is just one example of the many architectures that are possible. Personal computers that are based on Intel microprocessors often include multiple buses. One can be an I/O bus to connect peripherals, and one that connects directly to the processor 120 (often called a memory bus). Bridge components connect the buses together and perform any translation required due to different bus protocols.

“The computer system 100 can be integrated on a single chip, or set of chips in certain embodiments. It can also be incorporated into small form factors for personal use. It is common for processors, buses, onboard memories, and display/Io controllers to be all integrated onto one chip. Or, different functions can be divided into multiple chips with point to point interconnection. This makes the bus logically obvious but not physical from either the actual device nor the related schematics.

“FIGS. 2A and 2B are processor-memory charts that describe the components of the system according to certain embodiments. FIG. FIG. 2A shows the system 200 as shown in FIG. 2A, the system 200 shown in FIG. Optional data exchange module 245 is able to exchange data with other computer-readable media. The database 215 is connected to processor 205. It can also be connected to a nontransitory storage medium to store data that is viewed as a plurality or sets of discrete pictures. The navigation engine 220 is connected to processor 205. A non-transitory storage medium allows for the assembly of each independently viewable set of discrete photos as a data sequence of discrete photographs. The navigation device 211 can be connected to navigation engine 220 to allow for efficient selection and viewing of each subset of the individual images.

The system also includes an input device (not illustrated) that can receive data on a nontransitory computer-readable medium. A data exchange module 245 is an input device that can interact with external data formats, voice recognition software, a hand-held device, as well as a camera, or other video image transmission and capture device, are examples of such devices. The system can also be modified to receive analog or digital audio and video.

“The image database 215 may be used to store image files that can be accessed on a non-transitory computer-readable storage medium. The system may store original images, copies of image files and other information, depending on the embodiment. Any image file that is known to one skilled in the art can stored. This includes digital data that can easily be rasterized to be used on a printer or computer display. Image file formats can be used to store data in various formats, such as uncompressed, compressed or vector. The system may be able to receive, store and give access to any number of image formats via a data exchange module.

“In certain embodiments, images may be stored in DICOM formats, such as those used in picture archiving systems and communication systems (PACS), used in modern medical imaging technology. DICOM (Digital Imaging and Communications in Medicine) is the universal format for PACS image storage and transmission. Once DICOM has been encapsulated, non-image data such as scanned documents can be used to incorporate them using standard formats from the consumer sector like PDF (Portable Document Format).

“Other formats include vector, HDR raster and compound. Stereo video is also available. JPEG/JFIF is one example of a raster format. JPEG 2000, Exif and TIFF are all examples. HDR raster formats include but aren’t limited to: RGBE (Radiance HDR), and IFF-RGFX. Other file types of the raster type are JPEG XR (Radiance HDR), IFF-RGFX (IFF-style format up to 32 bits in planar representation plus optional 64 bit extensions), ILBM [IFF-style format used for TVPaint], DEEP (IFF – Image Environment Manager file; planar, run length encoded), IMG, IMG (Graphical Environment Manager file; planar), IMG, IMG (Graphical Environment Manager file; planar), PSD (Corel Paint ShopPro), PSP (Corel), PSP (Corel Image Transport format), and VICAR (NASA/JPL file format), CGM, Gerber File Format RS-274X, SVG are some examples of vector formats. Other 2D vector formats include, but are not limited, CDR (CorelDRAW), DrawingML and GEM metafiles. These files are interpreted and written by Graphical Environment Manager VDI Subsystem), Graphics Layout Engine and Graphics Layout Engine and HPGL, HVIF, MathML, MetaPost and Myv vector formats, NAPLPS (North American Presentation Layer Protocol Sytax), ODG,!DRAW and POV-Ray markup languages, PPT (Microsoft Metafile/Enhanced Metafile/Windows Metafile/Enhanced Metafiles Metafiles Metafile), and Xar. The 3D vector formats are: AI (Adobe Illustrator), CorelDRAW), DrawingML and GEM metafiles. Graphics Layout Engine, HPGL. HVIF (Haiku Vector Icon Format), MathML. MetaPost, Myv. NAPLPS (North American Presentation Layer Protocol Syntax), ODG(OpenDocument Graphics),!DRAW), POV-Ray markup languages, PPT (Microsoft PowerPoint), Precision Graphics Markup Languages, PSTricks/TikZ), Xar Format, XML Paper Specification), XPS (XML Papers). Some examples of compound formats are: AI (Adobe Illustrator), DrawingML and GEM metafiles Graphics Layout Engine. HVIF (Haiku Vector Icon Format), MathML and MetaPost. Myv vector format is NAPLPS (North American Presentation Layer Protocol Syntax). ODG (OpenDocument Graphics),!DRAW. POV-Ray markup language. PPT (Microsoft PowerPoint), Precision Graphics Markup Language. PSTricks, PGF/TikZ. Stereo formats include MPO, PNS and JPS.

“One skilled person will recognize that the teachings herein are not restricted to certain file formats and that any audio/video format that is known to one of skill can be used in some embodiments. The audio file may be a single audio codec-compatible format, or it can include multiple codec-compatible formats. In some cases, however, the audio files are multi-codec compatible. Some embodiments include an uncompressed audio format, such as WAV, AIFF and AU. Some embodiments include lossless compression, such as FLAC, Monkey’s Audio with file extension APE and WayPack with file extension WV. Shorten, Tom’s lossless Audio Kompressor, (TAK), TTA. ATRAC Advanced Lossless. Apple Lossless. And lossless WINDOWS Media Audio. Some embodiments include lossy compression such as MP3, Vorbis and Musepack, ATRAC lossy WINDOWS Media Audio, (WMA), and AAC.

“In some embodiments the audio format is an uncompressed PCM format audio format, as well as a.wav? For a WINDOWS computer-readable media or as a?.aiff? as a MAC OS computer readable medium. A Broadcast Wave Format (BWF), which allows metadata to be stored in the file, can be used in some embodiments. The audio format can be lossless, such as FLAC or WayPack, Monkey’s Audio or ALAC/Apple Lossless. The lossless audio format can compress to a ratio of approximately 2:1 in some embodiments. The audio format can be free-and-open in some instances, such as way.ogg, flac.aiff, raw.au, and mid. Some embodiments of the audio format are an open file format such as gsm. dct. vox. mp4/m4a. or mmf. Some embodiments use a proprietary audio format such as mp3, atrac, or ram.

“In addition to the system, an output module (235) can be included in a non-transitory computer-readable medium. The output module is capable of transmitting data to an out device. This can be a graphical user interface or video display. Optionally, one or more output devices can be supported by the output module 235. The output device may be able to transmit audio data to the user. This data can be used by the user to view image data.

“In some embodiments the input device includes a microphone or camera. In some embodiments the output module 235 transmits images, sets of images or a video stream to an interface. Some embodiments include a speaker or graphical user interface. In other cases, the output device may also include a speaker and/or a graphical interface.

One of the most skilled people will know that data streams can be assembled by time stamping data samples. An audio data stream can be combined with a graphic display in some embodiments. The audio data can be in any format that is known to one skilled.

The system can be modified to allow for the modification of images, enhancements, combining images, average images and changing image formats. The systems may also include the transformation module 240, which can be connected to the processor. It can also be stored on a non-transitory computer-readable storage medium. This allows the user to transform the image data into modified images. The user can also be able to choose images from within a data stack using, for instance, subjective user selection or one or more of the software image filtering algorithms, other known methods, or default image criteria. The system can then parse images into a desired subset by the user. This functionality can be provided by any engine or module described herein or built into a dedicated module. However, certain embodiments use the transformation module 240 to perform this function. The system can also include image enhancement. The transformation module 240 can thus be used to modify the desired subset of images by image enhancement.

Communication with another user is beneficial for both the one who has the skill and the other. The second user could be another physician, or any other professional who can help with the interpretation or analysis of an image or image-data-stack. The system may also include a data exchange module 245 that allows for the sending and receiving of data with another user. A state selector can be included in the navigation device to control the sending and receiving of data with the second user. The data exchange module 245 can be embedded in a non-transitory computer-readable medium. It can also exchange data with other computer-readable media. For example, the data exchange module 245 can be used as a messaging module that allows users to communicate with each other using subject-profiles or users who are not part of a particular profile. This is possible merely by electing the user. Users can communicate with one another by email, posting blogs or using instant messaging to facilitate real-time communication. Some embodiments provide video and audio capabilities for the communication. The system uses data streaming methods that are well-known to those skilled in the art. Some embodiments include the system in a hand-held device. The device can be used to perform as a specific machine or apparatus with the additional function of gaming, telecommunications, or word processing; or as a machine or apparatus that does not have any other substantial functions.

“FIG. “FIG. One of the most common examples is scrolling too fast to miss image data due to indexing and scrolling in a data-stack. The teachings contained herein can help prevent this from happening. The systems, components and devices described herein can control the speed with which images are reviewed, while still allowing for rapid scrolling to the area of interest. The teachings include systems and methods that use a dwell module 250 to control the speed at which images are viewed in a data-stack. The dwell module 250 can also be used to control the speed of scrolling.

“A skilled person will recognize that the production of video streams of medical information can be very valuable in diagnosing or understanding a disease. The image enhancement described herein may include the storage, display and/or creation of a video stream using the selected subset of images. The systems and methods described herein may include a video engine (255) for creating and/or displaying a data-stack video stream.

“One with skill will also be able to analyze the images in the data-stack through dictation. Voice commands can be provided as images are reviewed. The systems and methods described herein may include a dictation module 266, which allows the user to prompt, receive, and/or process the analysis as input via voice or text commands.

“One with skill will also be able to recognize that an analysis can be done on the data-stack images using a systematic analysis. This can either be a default or customized systematic analysis script. Both can have script?pathways. The system will follow the user’s previous responses or responses. In some embodiments, the system can prompt the user by a default or custom analysis script while the images are being reviewed. The systems and methods described herein may include an analysis module 265 that prompts the user to review images automatically or upon request. A scripted analysis could be, for instance, a link between a series of images and a list of queries about that type? of the image set. The?type? can be any combination of the above. The?type? of an image set could be either imaging technology, (iii), disease state, (iiii), region of the body or any combination thereof. The queries may be either default queries or customized queries that are specific to a physician, practice group or geographical area, standard or care, patient or disorder, or any combination thereof. For example, the dictation module can link one or more sets of images in the data-stack to a default list of queries chosen from a group that includes queries based on imaging technology or a disease or disorder state, region of body, standard of care or any combination thereof. The dictation module may link one or more images from the data stack to a custom list of queries. This can be done based on the preference of a physician, a practice group, a specific patient, variations in a disease state, a set or combination of these, or any combination thereof.

“The user interface 270 can be connected to the processor. It can contain a non-transitory computer-readable medium that allows for the modification of a user control such as the navigation device 211,275, which is the scrolling state selector 221 and/or indexing state selector 213 respectively. The user control interface (270) can alter, for example, speed or acceleration of scrolling. It also allows you to linkage between set of images or subsets of images or discrete pictures. The user control interface may also be used to control other I/O devices such as a keyboard and disk drives, printers, scanners, and any other input or output devices including a mouse, pointing device, or one or more monitors (graphical interfaces).

The systems described herein can be used with many different system configurations including personal computers, multiprocessors systems, microprocessor-based consumer electronics, mainframe computers, network computers, minicomputers, mainframes computers, and so on. These teachings can also be used in distributed computing environments, where remote processing devices are connected through a communication network to perform tasks. In some embodiments, the system also includes an external computer connection via the data exchange module 245, and a browser programming module (not shown). As part of the data exchange 245 module, the browser program module (not illustrated) can be used to access external data.

“FIG. “FIG. The components of the system 300 can be used in a typical embodiment. The image database 215 includes the navigation engine 225, the indexing module 22.5, scrolling module 233, and output module 235 as shown in FIG. 2. The memory 210 of device 300 also contains a browser program module (not illustrated) and a data exchange module 245 for accessing external data. The system has a speaker 352, display 353, as well as a printer 354, which can be connected directly to the I/O backplane 350.

“In certain embodiments, the system 300 may be implemented as a standalone device rather than in a network or computer system. FIG. FIG. 3 shows the I/O device 350 connecting to the speaker (spkr), 352, and microphone (mic). Other features could also be connected to it. This device could have a left hand indexing state selectionor 341, a scrolling state chooseor 342, and a righthand indexing selector 343. A right-hand scrolling selector 344 is also possible. indexing state selector 345. An?nth Scrolling state selector 345, an?nth?

“In certain embodiments, the system also includes security measures to protect the subject?s privacy, integrity, or both. These security measures include software and firewalls. The system can also be configured to work in environments that require administrative control and procedures. The system could include an administrative module (not illustrated) that can be used to manage access, configure engines, monitor results and perform quality assurance tests. It also allows for the definition of audiences and target audiences. The system can be safely provided over a network. In some cases, the system can also be coupled to a network. Security measures can help protect the system’s contents from outside intrusions.

“In certain embodiments, the system can be a web-enabled application. It can use, for instance, any Hypertext Transfer Protocol (HTTP), or Hypertext Transfer Protocol over Secure Socket Layer(HTTPS)) that is available to one of its skilled users, such as HTML5. These protocols offer rich experiences for end users by using web 2.0 technologies such as AJAX and Macromedia Flash. The system can be used with Internet Browsers such as Internet Explorer and Mozilla Firefox. The system can be used with certain mobile devices that support HTTP/HTTPS, such as iPhones, PocketPCs and Microsoft Surfaces. The system can be accessed via a Wireless Application Protocol (WAP) in some instances. This protocol can be used to access the system from non-HTTP enabled mobile devices such as Cell Phones and BlackBerries. It also provides an easy interface. Because of protocol limitations, Flash animations have been disabled and replaced by Text/Graphic menus. The system can be accessed in some embodiments using a Simple Object Access Protocol, (SOAP), and an Extensible Markup Language(XML). The system allows third-party and custom applications to query the core database and interact with it by exposing it via SOAP or XML. You could create custom applications that run on iPhones, Java, or other.Net-enabled platforms. The system can be used on any platform, and it will adapt to new platforms as they are developed.

“FIG. “FIG. The method generally involves storing 405 data-stacks on a database that can be connected to a processor. The database can store the data as a plurality or sets of discrete pictures. A navigation engine that can be connected to the CPU and on a not-transitory storage medium is used to index the discrete subsets. Scrolling through the data series with the scrolling module and processor will allow you to select 425 from each independently viewable set of discrete photos. Finally, the navigation device is used to the engine to control the engine allows you to choose 425 of each subsets. Point-free selection can be used to select and scroll 430. This could include: (i) independently selecting and scrolling the desired subset from the independently viewable subsets using an indexing state chooseor, the selected subset indexed for an efficient selection using a pointless, activation of a state selector; and (ii) scrolling through each of the independently viewable subsets of the discrete pictures as a data sequence of the discrete photos with a scrolling selector. A graphical user interface can be used to view 435 images within the data-stack. After that, the processing of the viewing will complete and the user can provide analysis of the images.

“FIG. FIG. 5 shows a prior art navigation device that is used to view a data-stack consisting of images. The device is a mouse with a selection and scroll button. One of skill will be able to appreciate the improved efficiency of the systems, components and devices described herein. In some embodiments, one can view the data stack in less than five percent, at most 10%, at minimum 15%, at best 20%, at worst 40%, or any other range in increments below 1%. Some embodiments increase the viewing time by 5% to 50%. 5% or 30%. 5% or 20%. 5% or 15%. 6% to 40%. 7% to 25%. 10% to 20%. 7%. to 18%. 8%. to 16%. 9%. to 15%. Or any other range in increments of 1%. Some embodiments improve the viewing time by a greater percentage than the second method, such as 5% to 40%, 5% to 10%, 15% or 50%.

“At least substantially” is used in the teachings herein. A value that is not significantly different from the reference value can be used. One value can be at least substantially the same value as a reference value if the standard deviation is not greater than one standard deviation from that reference value.

“The teachings herein are based on the medical field as a platform for discussing the advantages of the presented systems and methods. The teachings herein can be used to view any image data-stack. Some embodiments include radiographs and CT images in the medical image data. Magnetic resonance imaging is sometimes included in some embodiments of medical image data. In some cases, medical image data also includes sonographs. In some cases, the medical data also includes PET images. The teachings provide a method for viewing a data-stack containing medical images quickly and efficiently via a graphical user interface. These systems may include a processor, a database connected to it and on non-transitory computers readable storage media for medical image data. A navigation engine is connected to this processor and to a nontransitory storage medium for indexing each discrete subset of the images. A scrolling module can be connected to and connected to a nontransitory storage medium for assembly of each discrete subset of the images as a data sequence of discrete pictures for scrolling through each subset.

The universal format, as described herein includes PACS image storage and transmission using DICOM (Digital Imaging and Communications in Medicine). Some embodiments include a web-based interface that allows users to access the internet or Wide Area Networks. This could be a VPN (Virtual Private Network), or SSL (Secure Sockets Layer). Some embodiments may include client-side software that uses JAVASCRIPT, ACTIVEX and/or JAVA APPLET. A more robust PACS system that can connect to all the resources of the computer where the PACS system is running on is possible in some embodiments. This system may be able to accommodate frequent Web Browser or Java updates. The PACS system may support DICOM part 18, according to some embodiments. Web Access to DICOM objects (WADO), in some instances, is used to create the standard for exposing images and reports via the internet as a portable medium. The PACS architecture can be cross-platform compatible, which means that WADO can help increase the dissemination of images and reports to patients and referring doctors. In some embodiments, the system also includes an image backup to ensure HIPAA compliance. These embodiments automatically send copies of images from the image database to another computer for offsite storage.

“The teachings contained herein can be used for improving current, state of the-art image analysis systems and procedures, such as PACS systems. The systems, components and devices as well as methods used in this state-of the-art technology are hereby included by reference in all their entirety. For example, Strickland N. H. Arch Dis Child83:82-86 (2000); and Alamu F. O. International Journal of Computer Applications 34(4), 12 (2011). You should know that the current state-of-the art methods can search for and extract images using a dedicated PACS server. For example, you could use DICOM messages to find image attributes and then retrieve them through a?C?FIND?. query and a C-MOVE? query and a?C-MOVE? request. A query could include, for instance, a patient ID and an ID for the PACS user. The server returns a list C-FIND responses. Each response also contains a list DICOM attributes. These are populated with the values for each match. To select images, the user can extract the desired attributes from the response. C-MOVE and C-GET can be used to retrieve the images from the PACS server at the study, series, or image level (set or subset or discrete image). C-MOVE can be used most often within facilities and enterprises, while C-GET is more useful between enterprises. C-MOVE requests specify?where? The images should be sent with an identifier that is known about the destination. This will allow the server to map the destination to a TCP/IP port and address, as well as knowing all destinations in advance. C-MOVE, for example, uses different destinations on separate connections. C-GET on the other hand uses the same connection as the request and does not require that the?server be contacted. Knowing the destination of the TCP/IP address, port, and other information in advance allows for easier working around firewalls and network address translations. This is an environment in which C-MOVE messages might not be able to pass through. Other retrieval mechanisms such as WADO, WADO WS, and most recently WADO RS can be used in some embodiments. This is especially useful for cross-enterprise usage. These systems, components, devices and methods, which are described herein, at minimum speed up navigation of images using the state-of the-art systems. They efficiently handle image selection and review as well as reduce repetitive movements that result from the standard point-and click navigation devices.

To facilitate the independent selection and mapping discrete images to allow for efficient viewing and retrieval of them, the method may include giving each image its own identification means to provide a “linking mechanism”. The navigation device can be used to link the images and sets, subsets and discrete images. This allows for quick and efficient indexing. The means of identifying a discrete or set image can include any parameter that can help in filtering the images or parsing them. Some embodiments allow for the use of any number of criteria to parse or filter the images, including image type such as imaging technology, body part or objects imaged, position of the image within that body part or object and time imaged. Also, the subject can be identified, possibly including details about the subject such as name, age and sex, gender, ethnicity and disease, genomic markers or other correlating diagnostics. The indexing step may also include additional indexing/identification of each discrete image for an independent selection, such as one image or a custom-designed group of images. Some embodiments provide images with an alphanumeric identifier or bar code or another known method of identification. The identifiers may provide an indexing mechanism or linking mechanism that allows the user to identify a particular data-stack or set within it. Or a discrete image within it.

“FIGS. 6A-6D illustrate a ?point-and-click-free? Some embodiments describe the process of looking at images in a data-stack through the eyes of a user. FIG. FIG. 6A shows a graphic user interface 605 that allows the user to select from 610 images using the indexing state selector. This is done without the need for a point-and click motion. FIG. FIG. 6B shows a graphic user interface 605 that has a subset 615 from set 610 of images. The user can select the indexing state without having to use a point-and click motion. FIG. FIG. 6C shows a graphic user interface 605 that allows the user to select discrete images 615 from subset 610 of images. Each image can be selected by the user using a scrolling state selector. The scrolling state selector allows the user to view the selected images without the need for a point-and click motion. FIG. FIG. 6D is a graphical user interface 605 that displays a selected, discrete image. This image represents the best of the select images 620 in FIG. 6C. The desired image 625 may be one image within the select, distinct images 620 or the result of the user altering or enhancing the image in order to diagnose or display a disorder 630 in the select images 620. The desired image may be an average of several of the select, discrete pictures 620. The desired image may be digitally enhanced from one of the selected, discrete images (620), such as brightness enhancement, contrast enhancement, brightness enhancement, noise removal, or the difference between an image subtraction and another image in the data stack.

“In some embodiments, the unique identifiers or identifiers provide enough variation or permutations among images so that every image will have its own unique identifier among all of them. Each image can be unique among all images in an image database for a period of one month, six months, two years, five years, ten years, ten years, twenty years, 50 years or 100 years. The image database can be a master image storage system accessible via downstream computing systems using a computer network, such as the intranet or internet. The indexing state selector can also be modified to allow for a quick, efficient, one-click indexing of sets, subsets and discrete pictures. A scrolling state selector allows the user to scroll through the sets and subsets to discrete images. This reduces repetitive motions.

“FIG. “FIG. 7 shows a flowchart that illustrates the more complicated, slower and less intuitive point-and-click method for viewing a data-stack. This method may include storing 705 a dataset on a database that can be connected to a processor. The database can also be stored on a nontransitory computer-readable storage medium for storing data. Scrolling 727 through the Sagittal Series of Images, moving 728 the mouse and selecting an Axial Series of Images, pointing at an image representing the series and clicking on it to select; scrolling 729 through an Axial Series of Images, moving the cursor to select discrete Axia images, using the images and then clicking to review 730 of the images. Levels in the data-stack. Then, 740 the moving and pointing and clicking. Scrolling, clicking, and clicking for the rest of the?n. levels in the data stack.”

FIG. “As can be seen in FIG. The repetitive use of point-and click motions is laborious. One skilled person will recognize that the teachings herein improve efficiency by at least selecting sets, subsets and discrete images. This results in lower repetitions and, in some instances, elimination of the need for point-andclick on the graphical interface.

“To clarify and contrast the current state-of the-art with these teachings, the images in a state of the-art PACS display used in current image navigation are grouped into “stacks”. a series of images that are related. A stack of images can be linked by an imaging plane (e.g. axial, coronal, or coronal), reconstruction algorithm, bone, soft tissue, and brain. Other criteria. Point-and-click is used to select the images in a series. Then, scroll up and down with the mouse wheel to navigate in a linear fashion. Point-and-click combined with the mouse wheel results in repetitive motions that can lead to repetitive stress injuries. These systems, components and devices reduce time-related injuries and occupational costs caused by navigational limitations. They also provide a direct-selection mechanism which eliminates the need to click and point-and-click. While point-and-click may be available for the navigation device in certain embodiments, it is not necessary. The navigation device may include a scrolling platter, along with a series one-click buttons that correspond to specific locations in a data stack. The navigation device may include a number of scrolling platters that correspond to particular sets or subsets of discrete images and a series of one-click buttons that correspond to specific locations within the data-stack. In some embodiments, the navigation devices include a scrolling platter, a series of one click buttons, and a second scrolling plate, which corresponds to a graphical user interface. The systems described herein may be configured in many ways that are ergonomically and time-saving.

“FIG. “FIG. 8 shows a system that includes a direct-selection bilateral navigation device according to certain embodiments. The bilateral system 800 has two diagnostic monitors 805. Each monitor 805 is in operable communication to a navigation device 855 that is a rotating platter. A linking mechanism 860 (indexing selector), which is parsed into a plurality one-click buttons that directly link to equal parsed groups or?series of image stacks, is also included. The scrolling state chooseor 855 on the left and indexing selector 840 on the right can both be controlled by the left hand. However, the scrolling selector 855 on the right and indexing selector 840 on the right can be controlled with the right hand. Each monitor 805 displays stacks of images that have been grouped into series (Se 1, Se 2, Se 3 and Se 4 on the left monitor 805 respectively; and Se 5, Se 6, Se 7 and Se 8 on 805, respectively).

“FIG. “FIG. 9 shows the dynamics of using a system that includes a bilateral, direct selection navigation device. The bilateral system 900 has the left monitor 905 linked to the left scrolling selector 955, and left indexing selector 960 ergonomically placed for control with the left hand. In turn, the right monitor 905 is linked to right scrolling selector 955, and right indexing selector 960 ergonomically placed for control using the right hand. The button locations on each indexing state selector 960 correspond to the selection to and linkage of the desired series on the left and right monitors. These are then navigated using the appropriate left or right scrolling states selector 855. FIG. 9: Pressing button 2 will link left platter to series 2 (Se2), while pressing button 5 will link right platter to series 5 (Se5). The controls remain linked until the user changes them.

“In some embodiments, the order of series can be set by either a default selection or a user-created selection. A default order of review in software may be sequential. In this case, the user will view images in Se 1, Se 2, and Se 3. You can configure a custom-designed user selection to display the images in a different order. For example, Se 1, Se 2, Se 3 and Se 4. Perhaps the user prefers to switch between the left and right screens to balance their use of left and right hands during the day. For example, Se 1, Se 5, Se 6, Se 3, Se 7, Se 8, and so forth.

“In certain embodiments, where a point and-click mouse is part the system, once a series is linked with a scrolling state selector such as a platter and series, the user can point and-click the mouse on either screen. The left platter will lock-into scrolling strictly in accordance to the series currently index through the linking mechanisms on the left side monitor and the right platter will remain locked-into Scrolling strictly according the series currently index through the linking mechanisms on the right side monitor. This linking is independent of mouse position and allows the mouse to be used as an optional “third control”. This allows you to select a single image occasionally without having to scroll from one of the monitors. As a random selection monitor, a third monitor is possible. This flexibility can be achieved by using a mouse as an accessory tool in certain embodiments.

“FIG. “FIG. 10 shows a system with bilateral monitors. At least one monitor can have a plurality scrolling state selectors or linking state selectors according to certain embodiments. This illustration shows how multiple scrolling and linking mechanisms can be used on one monitor. FIG. FIG. 10 shows that the system 1000 includes a pair of monitors 1005 as well as a navigation device 1050. The monitor 1005 to the left (1) contains a single scrolling selector 1055, and a single indexing selector 1060 which are linked to each scrolling selector 1055. The right monitor 1005 has two (2) scrolling state chooseors 1055, and a plurality (2) of indexing selectors 1060 linked to the plurality (3) of scrolling selectors. You can select the controlling platter (2,3) and the linking mechanism for right monitor 1005 by using a button that can either be used separately or shared with a state chooseor. The platter (2-3) can be pushed to select the platter (2-3) and view the series associated to that platter at any time.

“FIG. “FIG. 11” illustrates a system with three monitors. Each monitor has its own platter and linking mechanism according to certain embodiments. This illustration shows how a plurality series can be linked using a plurality indexing state selectors in an one-to-one relationship. It also includes a plurality scrolling state selectors and monitors. This system reduces complexity, simplifies viewing and inherently reduces fatigue. The system 1100 includes three monitors 1105 (1 to 2) and 3 (3 to 3), each with their respective scrolling state selectors. FIG. FIG. 11 shows how a plurality of platters are combined with linking mechanisms into one navigation device 1150. It has scrolling state selectors 155 and indexing selectors 160. However, each navigation device can be used independently, which allows for easy positioning with any monitor. This configuration may be desirable to one of the skilled because it allows you to separate common view series onto their own screens. For example, (1) posterior-anterior; (2) lateral; (3) oblique; (1), axial; (2) coronal; (3) sagittal. A skilled person will appreciate the time and effort saved by having related series open with separate controls. This could translate into increased production and less repetitive motions, which in turn would reduce repetitive stress injuries.

The mouse scroll wheel can be used to compare relative repetitive movements between the platter and the mouse. If the distance traveled by a user’s fingers around (i), the circumferences of the scrolling wheels of the mouse and (ii), the platter circumferences are equal, and likewise, the distance/time of information movement across the monitor, then it is possible to compare the relative repetition of movements between the mouse wheel or the platter. We can assume that the average diameter of a mouse scrollwheel is between 0.75 and 1.25 inches. The average platter diameter is about 3.0 to 7.0 inches. To measure the distance traveled by the mouse scroll wheels across a monitor, we can use a similar method to that of a surveyor’s tool to determine the distance traveled on the ground relative to the distance traveled using the platter. The following table, Table 1, on scrolling efficiency uses this method, and assumes a 1:1 circumference:distance across the monitor, to compare the repetitions required to travel from top to bottom of a 17 inch computer screen (measured diagonal, corner-to-corner) with an aspect ratio of 16:10 (height:width), which is a distance of about 14 inches.”

“TABLE 1\nMouse scroll wheel Platter scrolling\nstate selector state selector\nDiameter (inches) 0.75 1.25 3.00 7.00\nCircumference (inches) 2.355 3.925 9.42 21.98\nTactile surface exposed 0.77 1.30 100% 100%\n(inches); distance per\nstroke (assume 33% of\nwheel circumference)\nRepetitive motions to 18.18 10.77 1.49 0.64\ntravel 14 inches = strokes strokes rotations rotations\n14/distance per stroke\nExcess repetitions of 18.18/ 10.77/\nmouse wheel over platter 0.64 = 0.64 =\n28.4x 16.8x\n18.18/ 10.77/\n1.49 = 1.49 =\n12.2x 7.2x”

“FIG. “FIG. 12 illustrates a system with?n? 12 illustrates a system with?n? monitors each having its own platter and linking mechanism according to certain embodiments. This illustration shows how a plurality series can be linked using a plurality indexing state selectors in an one-to-one relationship. It also includes a plurality scrolling state selectors and monitors. The figure shows that each monitor can be linked to a navigation device independently, depending on the subjective preferences. This system is simple to use, reduces complexity, and can be used to reduce fatigue. The system 1200 has the following features: Monitors 1205 (1. 2,. . . n) with the respective scrolling state selectors. FIG. FIG. 12 shows how a plurality of platters are combined with linking mechanisms to create one navigation device 1250. It has scrolling state selectors 1255, indexing state selectors 1206, and can also be used as an individual navigation device or subgroup of devices, which allows for easy positioning with each monitor. This configuration may be desirable to one of the skilled because it allows you to separate a number of common view series or uncommon view series on your own dedicated screens. . . You can view a series of images within a data-stack or simultaneously view series on multiple body regions, such as in a study to determine the spread of trauma in trauma patients or metastasis in cancer patients. You might also be able to simultaneously view series using more than one imaging technology such as CT or MRI, ultrasound, and so on. A skilled person will be able to see how having related series open with separate controls for each series would result in significant time savings, which could translate into production, as well as a reduction of repetitive motions that can lead to repetitive stress injuries.

“FIG. “FIG. 13” illustrates different embodiments of the indexing selector according to certain embodiments. The navigation device 1350 includes scroll inputs or scrolling state selectors1355 and a linking mechanism or indexing state choosers1360. The indexing state chooseors 1360 in this embodiment are buttons 1360 that can be linked to separate sets of images or subsets of images. Any one of the skilled will know that there are other technologies that can be used to link to separate sets of images, subsets, or discrete pictures. Gaze detection 1360b is an example of a technology that allows the navigation device detect whether a user is looking at one particular monitor. It can also determine whether the individual sets of images, subsets or discrete images are visible. The device will display the target of the user’s gaze if it detects that they are looking at the screen, independent sets of images or subsets of images. Gaze technology can trigger an automatic timer in dwell module. This will cause a timed scrolling to be initiated. The scrolling may stop when the device detects the user is looking away from the monitor or any of the independent sets, subsets, or discrete images on the monitor. When the device senses that the user is looking again at the device, the scrolling may be resumed. The buttons on the linking mechanism could also be used to select another state selector 1360c, such an indexed knob, switch or rotary selection device. The system can also index images using a preset protocol 1360d. This can be an autoselection that is based upon desired series parameters. It can also be used as a default setting such as axial, sagittal, and coronal images. You can also show axial images on one monitor and sagittal views on the other. Coronal views are shown on third monitor. The indexing mechanism doesn’t require a push button. In some cases, a vocal command 1360e is sufficient.

“FIG. “FIG. 14 illustrates different embodiments of the scrolling selector, according some embodiments. Scroll inputs or scrolling state selectors 1455 are part of the navigation device 1450. A linking mechanism or indexing state choosers 1460 is also part of the device. The scrolling state selectors 1455 in this embodiment are platters 1455 that can be linked to separate sets of images or subsets of images. The ability to link directly to separate sets of images, subsets, or discrete images for scrolling can be achieved with other technologies. You can use a slider switch/fader 1455b or a tactile scrolling surface 1455c, such as a finger treadmill. Alternately, the buttons of the linking mechanism could be any type of state selector 1360c, such an indexed knob, switch or rotary selection device. The system can also scroll images based upon a preset protocol. This can be an auto scroll based on series parameters that can be individually selected for each case or a default setting such as a scroll speed for axial views, scroll rates for sagittal views and scroll rates for coronal views. You can also set a scroll speed for each monitor. The scrolling mechanism doesn’t require a push of a button. In some cases, a vocal command is sufficient to change the scrolling speed.

The systems and methods described herein allow for the viewing of image data on a handheld device. However, the CPU of a handheld computer system can have problems concurrently processing audio data files. A handheld computing system might experience latency problems in some instances. As such, data files may require compression. In some cases, data files may need to be compressed with a compression technique such as QUICKTIME from Apple. You can also use other file compression techniques. In some cases, IMA4 can be used to compress files. The system will require a minimum of a 600-700MHz processor in some instances. A 400 MHz processor might be used by an older APPLE system, but a more modern system can use a 1300 MHz CPU. For example, the IMA4 compression method reduces audio file size to 25%. SMPTE, DIRAC and HEVC are all examples of video compression. It should be noted that some embodiments can also use uncompressed wave files. Due to the faster processors available, many home computers may not require compressed files. The computer system’s bandwidth, i.e. The size of the CPU, memory and other components will determine whether compression is required. A skilled person in the art will recognize that some compression technologies may be required in certain systems in order to achieve optimal performance. These technologies can also be easily identified and accessible.

“FIG. 15. This shows, in accordance with some embodiments, how a network can be used to support the system. A network 1505 is a way to connect multiple computer systems together, such as the internet and cellular networks. The term “internet” is used herein. The term “internet” as used herein refers a network that uses protocols such the TCP/IP protocol and possibly other protocols like the hypertext transfer protocol for hypertext markup languages (HTML) documents. Those skilled in the art are familiar with the physical connections and protocols and communication procedures that make up the internet.

Access to the internet 1505 can be provided by internet service providers (ISP), like the ISPs 1510 or 1515. Client systems such as 1530, 1550 and 1560 have access to the internet via the ISPs 1510, 1515. Client computer system users can access the internet to view, send and exchange information. These documents are often made available by web servers such as web server 1520, which is considered to have?on?. The internet. These web servers are often provided by ISPs like ISP 1510. However, a computer system can also be connected to the internet and set up without the need for an ISP.

“The web server 1520 typically consists of at least one computer system that acts as a server computer system. It is set up to work with the protocols of worldwide web and is connected to the internet. Optionally, the webserver 1520 may be part of an ISP that provides internet access for client systems. The web server 1520 can be seen coupled to the 1525 server computer system. This is also coupled to web content 1595 which can be considered a type of media database. FIG. shows two computer systems 1520, 1525. 15. The web server system 1520 is shown in FIG.

“Cellular network Interface 1543 is an interface between a cell network and the corresponding cellular device 1544, 1546, and 1548 on the one side and network 1505 on both sides. Cellular devices 1544-1546 and 1548 can connect to network 1505 to exchange information, such as email, content or HTTP-formatted files. Cellular network interface 1543 can be coupled to computer 1540. This connects to network 1505 via modem interface 15.45. Computer 1540 can be used as a gateway, personal computer, or server computer. Computer 1540 could be similar to client computers 1550 or 1560, or to gateway computer 15,75. The connection between interface 1543, computer 1504, and modem 1545 allows software or content to be uploaded or downloaded.

Client computer systems 1530-1550 and 1560 can view HTML pages from the web server 1520 using the appropriate web browser software. The ISP 1510 provides internet connectivity for the client computer systems 1530 and 1550 through the modem interface 1505, which can also be considered part the client computer network 1530. A client computer system could be a personal, network, or other type of computer system.

“Similarly, the ISP1515 provides internet connectivity to client systems 1550-1560. However, as illustrated in FIG. 15 connections are different from those for computers that are directly connected. Client computer systems 1550, 1560 form part of a LAN that is connected through a gateway computer 1575. FIG. FIG. 15 illustrates interfaces 1535, 1545 generically as a “modem”,? Each interface can be an analog, isdn, or satellite modem. ?direct PC? ), or any other interfaces that allow a computer system and other computers to be connected.”

Client computer systems 1550, 1560 can be coupled to a LAN1570 via network interfaces 1555 or 1565. These interfaces can be ethernet networks or other network interfaces. A gateway computer system 1575 is also connected to the LAN 1570, which provides firewall and other internet-related services for the local network. The gateway computer system 1575 can be coupled to the ISP1515 to provide internet connectivity for the client computers 1550 and 1560. The gateway computer system 1575 may be a traditional server computer system. The web server system 1520 is also a traditional server computer system.

“Alternatively, a server computer 1580 can be connected to the LAN 1570 via a network interface 1585. This allows clients 1550, 1560 to access files 1590, and other services 1590, without needing to connect to internet through the gateway 1575.

The system can provide social networking by allowing users to contact each other through such a network. The system may include a messaging module that can send notifications via SMS, email, or other media. The system can be accessed through a portable single-unit device in some embodiments. In other embodiments, the input device and graphical user interface are provided via a single portable unit device. The portable, single-unit device can be a handheld device in some instances. The systems and methods may operate from the server and user to one another, or from the user and a server and from one user to the other, or from one user to the server and from one user to the server and from one user to the server and from one user to the server and from one user to the server and from another user to the server and from one user to the server and from one user to the teacher (or plurality if teachers), or from one server to several users and a conductor. Interactions can take place through real-time users. These interactions may be available in a forum that is either public, private or semi-private or member-only. Or, they can not be real-time such as a user to a server to a plurality of users and a teacher (or plurality of teachers). An example of an environment that isn’t real-time is a blog-type or message room.

“A real-time environment responds to communications within a set time constraint, or?deadlines?” For example, real-time responses can be provided in milliseconds or microseconds. They can range from 0.01 milliseconds up to 999 milliseconds. 0.03 milliseconds up to 600 milliseconds. 0.04 milliseconds up to 600 milliseconds. 0.06 milliseconds down to 400 milliseconds. 0.08 milliseconds up to 300 milliseconds. 0.07 milliseconds up to 400 milliseconds. 0.08 milliseconds.10 to 10 to 10 milliseconds. The system responds in some cases without any noticeable delay. The network can be configured to send text and/or sound for real-time messaging and posting of messages, instructional posts, news postings, or other items that are of interest to users.

“A network can also include traditional media to allow users and the public to communicate. This includes satellite, optical fiber, satellite and television cable. These digital information can be sent to users. This will allow you to use the information provided in this article with traditional media channels. Some embodiments allow the systems, components and devices to be used to provide non-confidential data, which is information in which confidentiality has been legally waived. This allows for information sharing over the network.

The following examples illustrate the use of the teachings. The examples are intended to illustrate the principles and should not be taken as limiting.

“Example 1. “Example 1.

This example shows how long it takes to analyze a set thoracic or abdominal cases with a traditional mouse control and an ergonomic keyboard. It also compares the time taken by a traditional mouse control that uses a point-and click mouse control, and an ergonomic keyboard that has scrolling and indexing controls such as a scrolling state selector and an indexing state selector. Comparative studies were conducted on three (3) thoracic and three (3) abdominal cases. Images from the thoracic studies were broken down into 400-419 images that showed axial, coronal and sagittal views. The data stacks for abdominal studies included 415-465 images, divided into 4 subsets showing axial, coronal and sagittal views. This example’s results are shown in Table 2.

“TABLE 2\nMethod\nTraditional Ergonomic Traditional Ergonomic\npoint-and- index-and- point-and- index-and-\nclick scroll click scroll\nRegion\nAbdominal Thoracic\nRun 1 3.37 2.75 4.25 3.53\n(minutes)\nRun 2 3.83 3.08 4.50 3.68\n(minutes)\nRun 3 4.25 3.58 4.08 3.48\n(minutes)\nRun 1 0.62 0.72\ntime saved\n(minutes)\nRun 2 0.75 0.82\ntime saved\n(minutes)\nRun 3 0.67 0.60\ntime saved\n(minutes)\nAVG 41 43\ntime saved\n(seconds)\nST DEV 3.9 6.6\ntime saved\n(seconds)”

The ergonomic system can save you time statistically, as shown in the following example. This time savings can translate into less repetitive motions and less repetitive stress injuries for the radiologists, as well as a more productive day. The time savings can also lead to a better focus by the radiologist on the readings, which may result in higher-quality diagnoses. The term “higher quality” may be used in some instances. The term “higher quality” can also refer to a decrease in reading errors. These errors can be reduced by at minimum 50%, at most 40%, at best 30%, at worst 20%, at worst 10%, and at most 5% in certain embodiments. The term “higher quality” may be used in some embodiments. The term “higher quality” can refer to an increase or identification of diseases or disorders. In some embodiments, the increase can be as high as 50%, 40%, 30%, 20%, 10% or 5%.

“Example 2. “Example 2.

This example shows how a dwell module is used to control the speed or dwell time at which a radiologist reviews one or more images within a data-stack. It may be beneficial to control and/or monitor the speed at which images are reviewed by subgroups, groups, or individual images. This may also be advantageous from the standpoint of providing timely services.

Summary for “Rapid analysis of medical imaging data”

“Field of Invention”

The teachings concern a navigation system that allows you to view an image data stack faster and with less repetition, such as a data-stack of medical images.

“Description of Related Art”

Radiologists use cutting-edge imaging technology in order to examine organs and tissue to diagnose injuries or illnesses and begin treatment. Radiologists used film Xrays in the beginning, but today radiologists have many imaging tools available to them, including X-ray radiography (CT), magnetic resonance imaging, positron emission tomography, and nuclear imaging. Digital technology has made it possible to transmit image data via the internet. Modern radiologists can now practice anywhere there is internet access. Telemedicine is a valuable tool for society as it allows skilled, urgent consultations and collaborations even after hours. Problems can arise in the provision of such services. The modern radiologicist is often required to work for long periods of time at a traditional computer station. This allows him or her to efficiently analyze images and deliver diagnoses using traditional computer tools.

The problem is made worse by the fact that digital imaging has made it possible to quickly produce and send numerous medical images to radiologists, faster than ever before. A data-stack might have contained only axial images 20 or so years ago, but the data-stack can now be reconstructed using multiple imaging planes, multiple reconstruction algorithms or three-dimensional models. A radiologist might have presented 20-30 images per case 20 years ago. However, now the radiologist could be presented with 2000-3000 images. This slow-step affects the radiologist’s ability to use traditional computer tools, which still include the point and click mouse, as a navigation device. It makes it more difficult and time-consuming for him or her to sort, select and view the growing number of images. The current limitations of navigation devices make it difficult for the radiologist to fulfill the job requirements, including providing consistent and reproducible analyses of large data stacks as quickly and accurately as possible.

These problems related to handling and viewing data-stacks have been solved by systems that can format, store and distribute data in a universal way. Picture archiving systems and communication systems (PACS) have made it possible to store and retrieve image data in various formats (imaging modes). This allows images and reports to be sent digitally. It also eliminates the need to file, retrieve or transport film jackets. PACS is made up of four main components. PACS has been able to reduce the physical and time limitations associated with traditional film-based image retrieval and distribution. However, it has not addressed the inefficiencies at the radiologist?s workstation. For example, a radiologist who views thousands of images per day uses a computer system very similar to one used by an ordinary user. However, they are not subject to the same production requirements and time constraints. The system will be used by both the radiologist as well as the average user. It includes a processor, an image database, a graphical user interface to view the images and, most importantly, the traditional point and click mouse for selecting and pointing-to the image data. This allows for the viewing and interpretation of images by subgroups, groups, and individually.

The inefficiencies at the traditional radiology workstation are a source of significant problems. It is possible to reduce the time required to interpret and to concentrate on the benefits for all. Reducing the use of the traditional “point-and-click” method. Steps inherent in the standard mouse? Control will reduce redundancies and inefficiencies at radiologist’s stations, which in turn will result in fewer repetitive stress injuries for modern radiologists. A study on repetitive stress injuries among radiologists in a PACS-based radiology section showed that 73 respondents responded to the survey (a 68% response rate). Boiselle, P. M. J. Am Coll Radiol. 5(8):919-23 (2008). Most respondents reported that they worked more than eight hours per day on a personal computer or PACS system monitor. Recurrent stress symptoms were reported in 58% of the respondents. 38% reported prior diagnoses of repetitive strain syndrome. See Id. Abstract

“The teachings herein will improve the radiologists’ workstation and help them overcome human limitations that are associated with traditional methods of navigating through the data stack. The images. A modern workstation will be appreciated by someone with skill. It (i) reduces time needed to review a case. (ii). Allows the radioologist to concentrate more on the act and not the navigation of data. (iii). Reduces repetitive stress injuries caused by multiple movements required to sort, navigate, select, view, and interpret data from images.

Image analysis systems components, devices and methods are available, including an image navigation system, which allows for quick, efficient viewing of an image stack. Systems, components, devices, methods, and systems are designed to reduce time and repetitive motions when viewing the image-stack of data. A navigation system allows for the faster and more efficient viewing of an image stack using less effort and less repetitive motions. For example, the navigation device can contain: (i) an image subset selector that allows you to select an image subset from the image data stack; (ii) a scrolling selector that allows you to scroll through the subset of discrete images as a data series. A graphical user interface is also possible to be connected to the processor in order to view the plurality set of discrete images. These systems, components, devices and methods are designed to solve the problem of providing a rapid, efficient way to view a data-stack with images. They can be implemented, for instance, “point-free?”. “Steps and less repetitive motions.”

The teachings concern a navigation system that allows you to view an image stack faster and with less repetition, such as one of the data stacks of medical images. The navigation devices in the systems, components and devices described herein can be configured to improve efficiency and movement in the viewing of the data stack of images. For example, the navigation device can have: (i) an Indexing State Selector to select a desired subset from the independently viewable subsets; (ii) A Scrolling State Selector to scroll through the selected subset as a data sequence of the discrete pictures. As with traditional computers, one or more graphic user interfaces can be connected to the processor for, for example, viewing a plurality of discrete sets. These systems, components, devices and methods allow you to view a data-stack with images in a more efficient way by using ‘point-free’ technology. Steps and less repetitive motions.”

The systems may include a processor, a database connected to it and on non-transitory computers readable storage media for storing data. A navigation engine is connected to a processor and on non-transitory computers readable storage media for parsing the plurality set of discrete pictures into independent subsets. An indexing module connected to processor and on non-transitory storage medium for pointless indexing each of independently viewable parts of the images. The scrolling module allows for reviewing each subset of discretes.

The system can be modified to allow for the following: “In addition to allowing users to view images quickly and efficiently, it can also include the ability to alter images, enhance images and combine images, average images and subtract images from others, change the image format and other functions.” The systems may also include a transformation module that can be connected to the processor as well as a non-transitory computer-readable storage medium. This allows the user to transform the image data into modified sets of images.

“Likewise, users can select images from within a data stack using subjective user selections, software communication links, image filtering algorithms, other known methods, default image criteria and the like. This allows for the selection of subsets from the data-stack. The system can then parse images into a desired subset that the user selects. This functionality can be provided by any engine or module described herein or built into a dedicated module. However, certain embodiments include a transformation module that provides this function. The system can also include an image enhancement function. The transformation module can be set up to alter the desired subset of images by image enhancement.

“One of the skillful will also recognize the value of communicating with another user or group. The second user could be a second doctor or another professional who can help with the interpretation or analysis of a medical picture or medical data-stack. The system may also include a data exchange module that allows users to send or receive data with each other. A state selector can be included in the navigation device that controls sending and receiving with the second user.

“One with skill will see that scrolling too fast or overlooking images can be a problem when scrolling through a data-stack. The teachings include systems and methods that use a dwell module to control the speed at which images are scrolled through in a data-stack. The dwell module can also be used to control the speed of scrolling.

“One with skill will also recognize that video streams of medical data may be useful, for example, in diagnosing or understanding a disease. The image enhancement systems described herein may include the creation, storage, display, or manipulation of a video stream using a selected subset of images. Scroll module navigation can also allow for manipulation of video streams. The systems and methods described herein may include a video engine that produces and/or displays a video stream and/or allows for the navigation of the video stream of images within the data-stack. In some embodiments, the video engine may include a frame graber to select an image from the video stream.

An individual of sufficient skill will be able to link specific image review steps with dictation while images are being reviewed. The systems and methods described herein may include a module that allows for prompting, receiving, or otherwise processing data-stacks based on criteria, such as dictation templates. For example, the user may input their analysis via voice or text.

“One with skill will also be able to recognize that an analysis can be done on the data-stack images using a systematic analysis. This can either be a default or customized systematic analysis script. Both can have script?pathways. The system will follow the user’s previous responses or responses. The user may be prompted with either a default or custom analysis script when the images are being reviewed. The systems and methods described herein may include an analysis module that prompts automatically or upon request. This allows the user to analyze one or more images. The dictation module, for example, can link one or more images in the data-stack to a default list of queries that are selected from a group of queries based on imaging tech, a disease or disorder state, region of body, standard of care or any combination thereof. In some cases, the dictation module may link one or more images from the data stack to a custom list of queries. This can be done using a group that includes queries based on a physician or practice group preference, a specific patient, variations in a disease state, a set or combination of symptoms or a combination of these.

“The ?point-free? “The?point-free? method is much more efficient than state-of the-art methods. It involves fewer repetitive actions and steps. Some embodiments allow for the user to quickly and efficiently view a data stack through a graphical interface. This can include: storing a dataset on a processor that is connected to a navigator engine and on non-transitory computers readable storage media; indexing each subset of the discrete pictures for an independent selection with an indexing module connected to both the processor as well as on a computer readable storage media to enable point-free indexing; scrolling through each subset of the discrete photos with a navigator Point-free selection can be used to select a subset of the independently viewable subsets using an indexing state chooser. The desired subset is indexed for an efficient selection with no point-free activation of that state selector. Scrolling through the subset of discrete images as a data series with a scrolling selector allows you to scroll through the subset. A graphical user interface can be used to view the images within the data-stack. After completion of viewing, the user can provide analysis of the images.

The systems, components and devices described herein are more efficient than current state-of the-art methods. “One skilled person will be able to appreciate the improved efficiency of the systems, components, devices, or methods. In some embodiments, selecting can be completed in less than 10 minutes.

“The teachings herein are based on the medical field as a platform for discussing the advantages of the presented systems and methods. The teachings herein can be used to view any image data-stack. Some embodiments include radiographs in the medical image data. Some embodiments include magnetic resonance imaging in the medical image data. Some embodiments include sonographs, CT and PET images in the medical data. The teachings provide a method for viewing a data-stack containing medical images quickly and efficiently via a graphical user interface. These systems may include a processor, a database connected to it and on non-transitory computers readable storage media for medical image data. A navigation engine is connected to this processor and to a nontransitory storage medium for indexing each discrete subset of the images. A scrolling module can be connected to and connected to a nontransitory storage medium for assembly of each discrete subset of the images as a data sequence of the images. The scrolling module allows for the user to scroll through each discretes

“To allow for independent selection and mapping discrete images to facilitate a highly efficient viewing/retrieval, the method may include each image having its own identification means that can be linked to provide a?linking device? The navigation device can be used to link the images and sets, subsets and discrete images, allowing for quick and efficient indexing. The means of identifying a discrete or set image can include any parameter that can help in filtering the images or parsing them. The parsing and filtering of images can be done using a variety criteria such as the location of the image on the screen, type of imaging technology, body part or objects imaged, position of the image within that body part or object, and time imaged. Also, the subject imaged may include details about the subject such as name, age and sex, gender, genetic markers, or other correlating diagnostics. The indexing step may also include additional indexing/identification of each discrete image for an independent selection, such as one image or a custom-designed group of images. Some embodiments provide images with an alphanumeric identifier or bar code or another known method of identification. Some embodiments provide enough variation or permutations for each image to ensure that each image has a unique identifier. Each image or subset of images can be unique for any time period, including 1 month, 6 years, 2 years and 5 years. The image database can be a master image storage system accessible via downstream computing systems using a computer network, such as the intranet or internet. The indexing state selector can also be modified to allow for a quick, efficient, one-click indexing of sets, subsets and discrete pictures. A scrolling state selector allows the user to scroll through the sets and subsets to discrete images. This reduces repetitive motions.

“In some embodiments, a scrolling platter is included with a series one-click buttons that correspond to specific locations in a data stack. The navigation device may include a plurality scrolling platters that can each be set to correspond with a particular set of discrete images. Additionally, there are a number of one-click buttons that each correspond to specific locations in the data stack, which can all be pre-specified by the user. In some embodiments, the navigation devices include a scrolling platter, a series of one click buttons, and a second scrolling plate, which correspond to a second graphic user interface.

“One skilled person will recognize that repetitive point-and click motions can be laborious. The teachings herein improve efficiency through the selection of sets, subsets and discrete images. This results in lower repetitions and the elimination of the need for point-and?click on the graphical user interface. Particularly useful in situations where the user switches between multiple data-stacks is the ability of the scrolling selectionor (or plurality of scrolling chooseors) to keep an association with a particular subset of images. This can reduce the repetitive motions needed to review the images.

A navigation system is designed to allow for quick, efficient viewing of an image stack via a graphical user interface. This navigation system can be used for images that are not medically related. The navigation system is optimized for viewing image data stacks in less time and with fewer repetitive motions. The navigation devices in the systems, components and devices described herein can be configured to reduce time and repetitive movements when viewing the data-stack. For example, the navigation device can have: (i) an Indexing State Selector to select a desired subset from the independently viewable subsets; (ii) A Scrolling State Selector to scroll through the selected subset as a data sequence of the discrete pictures. A graphical user interface is also possible to be connected to the processor in order to view the plurality set of discrete images. These systems, components, devices and methods provide a quick, efficient way to view a data-stack with images. They can be implemented, for example, “point-free?”. Steps and less repetitive motions.”

“FIG. “FIG. Computer system 100 can be a traditional computer system that includes a computer, I/O devices 150 and a display device. The computer 105 may include a processor 120 and a communications interface125. It also includes memory 130, non-volatile storage 140, I/O controller145, and display controller 135. The I/O devices 150 or 155 may be connected to the computer system 100.

“The computer 105 interfaces with external systems through the communications connector 125. This may include a modem, network interface, or both. The communications interface 125 may be considered part of either the computer system 100, or the computer 105. The communications interface 125 could be an analog modem or isdn modem. It can also include a cable modem. ?direct PC? ), or other interfaces that allow the computer system 100 and other systems to be connected. This interface may be used to communicate with a cell phone or another device that receives information in the same way. It can also include a cabled interface to connect with a personal computer. Two-way pagers are an example of a communications interface 125. It is usually a radio interface to communicate with a data transmission network, but it may also include a cabled interface or cradled interface. The communications interface 125 is typically a cabled or cradled interface. It may also include a radio interface such as a BLUETOOTH, 802.11, or cellular radio interface.

“The processor 120 could be, for instance, any suitable processor such as a conventional processor such as an Intel Pentium or Motorola power processor microprocessor, a Texas Instruments electronic signal processor or a combination thereof. A bus connects the memory 130 to the processor 120. The memory 130 may be dynamic random access memory, (DRAM), or static RAM (SRAM). The bus connects the processor 120 to memory 130 and also to non-volatile storage 140 to display controller 135 and I/O controller 145.

“The I/O device 150 can include a keyboard and disk drives, printers, scanners, and other input-output devices such as a mouse or other pointer device. The teachings include a navigation device with an indexing state selector or scrolling state selector. The display controller 135 can control the display on the display device 55 in a conventional way. It could be a cathode-ray tube (CRT), liquid crystal display (LCD), and light-emitting diode (LED) display. Both the I/O controller 140 and 135 can be used with well-known technology. They may even be combined.

“The non-volatile storage 140 can be either a FLASH memory, read-only memory or a combination of both. Although magnetic hard drives, optical disks and other forms of large-data storage may be used in certain embodiments, the form factors of such devices usually prevent them from being installed as permanent components in some devices. A mass storage device installed on another computer can be used with limited storage. This data is often written into memory 130 by direct memory access during the execution of software on the computer 105. A skilled person in the art will recognize the terms “machine-readable medium?” Or?computer-readable media? Any type of storage device that can be accessed by the processor 120. It also includes a carrier wave that encodes information. Non-volatile storage 140 can store objects, methods, inline caches and cache states, as well as other object-oriented components. It also allows for the writing of data information into memory 130, during execution of an object-oriented program.

“The computer system 100 is just one example of the many architectures that are possible. Personal computers that are based on Intel microprocessors often include multiple buses. One can be an I/O bus to connect peripherals, and one that connects directly to the processor 120 (often called a memory bus). Bridge components connect the buses together and perform any translation required due to different bus protocols.

“The computer system 100 can be integrated on a single chip, or set of chips in certain embodiments. It can also be incorporated into small form factors for personal use. It is common for processors, buses, onboard memories, and display/Io controllers to be all integrated onto one chip. Or, different functions can be divided into multiple chips with point to point interconnection. This makes the bus logically obvious but not physical from either the actual device nor the related schematics.

“FIGS. 2A and 2B are processor-memory charts that describe the components of the system according to certain embodiments. FIG. FIG. 2A shows the system 200 as shown in FIG. 2A, the system 200 shown in FIG. Optional data exchange module 245 is able to exchange data with other computer-readable media. The database 215 is connected to processor 205. It can also be connected to a nontransitory storage medium to store data that is viewed as a plurality or sets of discrete pictures. The navigation engine 220 is connected to processor 205. A non-transitory storage medium allows for the assembly of each independently viewable set of discrete photos as a data sequence of discrete photographs. The navigation device 211 can be connected to navigation engine 220 to allow for efficient selection and viewing of each subset of the individual images.

The system also includes an input device (not illustrated) that can receive data on a nontransitory computer-readable medium. A data exchange module 245 is an input device that can interact with external data formats, voice recognition software, a hand-held device, as well as a camera, or other video image transmission and capture device, are examples of such devices. The system can also be modified to receive analog or digital audio and video.

“The image database 215 may be used to store image files that can be accessed on a non-transitory computer-readable storage medium. The system may store original images, copies of image files and other information, depending on the embodiment. Any image file that is known to one skilled in the art can stored. This includes digital data that can easily be rasterized to be used on a printer or computer display. Image file formats can be used to store data in various formats, such as uncompressed, compressed or vector. The system may be able to receive, store and give access to any number of image formats via a data exchange module.

“In certain embodiments, images may be stored in DICOM formats, such as those used in picture archiving systems and communication systems (PACS), used in modern medical imaging technology. DICOM (Digital Imaging and Communications in Medicine) is the universal format for PACS image storage and transmission. Once DICOM has been encapsulated, non-image data such as scanned documents can be used to incorporate them using standard formats from the consumer sector like PDF (Portable Document Format).

“Other formats include vector, HDR raster and compound. Stereo video is also available. JPEG/JFIF is one example of a raster format. JPEG 2000, Exif and TIFF are all examples. HDR raster formats include but aren’t limited to: RGBE (Radiance HDR), and IFF-RGFX. Other file types of the raster type are JPEG XR (Radiance HDR), IFF-RGFX (IFF-style format up to 32 bits in planar representation plus optional 64 bit extensions), ILBM [IFF-style format used for TVPaint], DEEP (IFF – Image Environment Manager file; planar, run length encoded), IMG, IMG (Graphical Environment Manager file; planar), IMG, IMG (Graphical Environment Manager file; planar), PSD (Corel Paint ShopPro), PSP (Corel), PSP (Corel Image Transport format), and VICAR (NASA/JPL file format), CGM, Gerber File Format RS-274X, SVG are some examples of vector formats. Other 2D vector formats include, but are not limited, CDR (CorelDRAW), DrawingML and GEM metafiles. These files are interpreted and written by Graphical Environment Manager VDI Subsystem), Graphics Layout Engine and Graphics Layout Engine and HPGL, HVIF, MathML, MetaPost and Myv vector formats, NAPLPS (North American Presentation Layer Protocol Sytax), ODG,!DRAW and POV-Ray markup languages, PPT (Microsoft Metafile/Enhanced Metafile/Windows Metafile/Enhanced Metafiles Metafiles Metafile), and Xar. The 3D vector formats are: AI (Adobe Illustrator), CorelDRAW), DrawingML and GEM metafiles. Graphics Layout Engine, HPGL. HVIF (Haiku Vector Icon Format), MathML. MetaPost, Myv. NAPLPS (North American Presentation Layer Protocol Syntax), ODG(OpenDocument Graphics),!DRAW), POV-Ray markup languages, PPT (Microsoft PowerPoint), Precision Graphics Markup Languages, PSTricks/TikZ), Xar Format, XML Paper Specification), XPS (XML Papers). Some examples of compound formats are: AI (Adobe Illustrator), DrawingML and GEM metafiles Graphics Layout Engine. HVIF (Haiku Vector Icon Format), MathML and MetaPost. Myv vector format is NAPLPS (North American Presentation Layer Protocol Syntax). ODG (OpenDocument Graphics),!DRAW. POV-Ray markup language. PPT (Microsoft PowerPoint), Precision Graphics Markup Language. PSTricks, PGF/TikZ. Stereo formats include MPO, PNS and JPS.

“One skilled person will recognize that the teachings herein are not restricted to certain file formats and that any audio/video format that is known to one of skill can be used in some embodiments. The audio file may be a single audio codec-compatible format, or it can include multiple codec-compatible formats. In some cases, however, the audio files are multi-codec compatible. Some embodiments include an uncompressed audio format, such as WAV, AIFF and AU. Some embodiments include lossless compression, such as FLAC, Monkey’s Audio with file extension APE and WayPack with file extension WV. Shorten, Tom’s lossless Audio Kompressor, (TAK), TTA. ATRAC Advanced Lossless. Apple Lossless. And lossless WINDOWS Media Audio. Some embodiments include lossy compression such as MP3, Vorbis and Musepack, ATRAC lossy WINDOWS Media Audio, (WMA), and AAC.

“In some embodiments the audio format is an uncompressed PCM format audio format, as well as a.wav? For a WINDOWS computer-readable media or as a?.aiff? as a MAC OS computer readable medium. A Broadcast Wave Format (BWF), which allows metadata to be stored in the file, can be used in some embodiments. The audio format can be lossless, such as FLAC or WayPack, Monkey’s Audio or ALAC/Apple Lossless. The lossless audio format can compress to a ratio of approximately 2:1 in some embodiments. The audio format can be free-and-open in some instances, such as way.ogg, flac.aiff, raw.au, and mid. Some embodiments of the audio format are an open file format such as gsm. dct. vox. mp4/m4a. or mmf. Some embodiments use a proprietary audio format such as mp3, atrac, or ram.

“In addition to the system, an output module (235) can be included in a non-transitory computer-readable medium. The output module is capable of transmitting data to an out device. This can be a graphical user interface or video display. Optionally, one or more output devices can be supported by the output module 235. The output device may be able to transmit audio data to the user. This data can be used by the user to view image data.

“In some embodiments the input device includes a microphone or camera. In some embodiments the output module 235 transmits images, sets of images or a video stream to an interface. Some embodiments include a speaker or graphical user interface. In other cases, the output device may also include a speaker and/or a graphical interface.

One of the most skilled people will know that data streams can be assembled by time stamping data samples. An audio data stream can be combined with a graphic display in some embodiments. The audio data can be in any format that is known to one skilled.

The system can be modified to allow for the modification of images, enhancements, combining images, average images and changing image formats. The systems may also include the transformation module 240, which can be connected to the processor. It can also be stored on a non-transitory computer-readable storage medium. This allows the user to transform the image data into modified images. The user can also be able to choose images from within a data stack using, for instance, subjective user selection or one or more of the software image filtering algorithms, other known methods, or default image criteria. The system can then parse images into a desired subset by the user. This functionality can be provided by any engine or module described herein or built into a dedicated module. However, certain embodiments use the transformation module 240 to perform this function. The system can also include image enhancement. The transformation module 240 can thus be used to modify the desired subset of images by image enhancement.

Communication with another user is beneficial for both the one who has the skill and the other. The second user could be another physician, or any other professional who can help with the interpretation or analysis of an image or image-data-stack. The system may also include a data exchange module 245 that allows for the sending and receiving of data with another user. A state selector can be included in the navigation device to control the sending and receiving of data with the second user. The data exchange module 245 can be embedded in a non-transitory computer-readable medium. It can also exchange data with other computer-readable media. For example, the data exchange module 245 can be used as a messaging module that allows users to communicate with each other using subject-profiles or users who are not part of a particular profile. This is possible merely by electing the user. Users can communicate with one another by email, posting blogs or using instant messaging to facilitate real-time communication. Some embodiments provide video and audio capabilities for the communication. The system uses data streaming methods that are well-known to those skilled in the art. Some embodiments include the system in a hand-held device. The device can be used to perform as a specific machine or apparatus with the additional function of gaming, telecommunications, or word processing; or as a machine or apparatus that does not have any other substantial functions.

“FIG. “FIG. One of the most common examples is scrolling too fast to miss image data due to indexing and scrolling in a data-stack. The teachings contained herein can help prevent this from happening. The systems, components and devices described herein can control the speed with which images are reviewed, while still allowing for rapid scrolling to the area of interest. The teachings include systems and methods that use a dwell module 250 to control the speed at which images are viewed in a data-stack. The dwell module 250 can also be used to control the speed of scrolling.

“A skilled person will recognize that the production of video streams of medical information can be very valuable in diagnosing or understanding a disease. The image enhancement described herein may include the storage, display and/or creation of a video stream using the selected subset of images. The systems and methods described herein may include a video engine (255) for creating and/or displaying a data-stack video stream.

“One with skill will also be able to analyze the images in the data-stack through dictation. Voice commands can be provided as images are reviewed. The systems and methods described herein may include a dictation module 266, which allows the user to prompt, receive, and/or process the analysis as input via voice or text commands.

“One with skill will also be able to recognize that an analysis can be done on the data-stack images using a systematic analysis. This can either be a default or customized systematic analysis script. Both can have script?pathways. The system will follow the user’s previous responses or responses. In some embodiments, the system can prompt the user by a default or custom analysis script while the images are being reviewed. The systems and methods described herein may include an analysis module 265 that prompts the user to review images automatically or upon request. A scripted analysis could be, for instance, a link between a series of images and a list of queries about that type? of the image set. The?type? can be any combination of the above. The?type? of an image set could be either imaging technology, (iii), disease state, (iiii), region of the body or any combination thereof. The queries may be either default queries or customized queries that are specific to a physician, practice group or geographical area, standard or care, patient or disorder, or any combination thereof. For example, the dictation module can link one or more sets of images in the data-stack to a default list of queries chosen from a group that includes queries based on imaging technology or a disease or disorder state, region of body, standard of care or any combination thereof. The dictation module may link one or more images from the data stack to a custom list of queries. This can be done based on the preference of a physician, a practice group, a specific patient, variations in a disease state, a set or combination of these, or any combination thereof.

“The user interface 270 can be connected to the processor. It can contain a non-transitory computer-readable medium that allows for the modification of a user control such as the navigation device 211,275, which is the scrolling state selector 221 and/or indexing state selector 213 respectively. The user control interface (270) can alter, for example, speed or acceleration of scrolling. It also allows you to linkage between set of images or subsets of images or discrete pictures. The user control interface may also be used to control other I/O devices such as a keyboard and disk drives, printers, scanners, and any other input or output devices including a mouse, pointing device, or one or more monitors (graphical interfaces).

The systems described herein can be used with many different system configurations including personal computers, multiprocessors systems, microprocessor-based consumer electronics, mainframe computers, network computers, minicomputers, mainframes computers, and so on. These teachings can also be used in distributed computing environments, where remote processing devices are connected through a communication network to perform tasks. In some embodiments, the system also includes an external computer connection via the data exchange module 245, and a browser programming module (not shown). As part of the data exchange 245 module, the browser program module (not illustrated) can be used to access external data.

“FIG. “FIG. The components of the system 300 can be used in a typical embodiment. The image database 215 includes the navigation engine 225, the indexing module 22.5, scrolling module 233, and output module 235 as shown in FIG. 2. The memory 210 of device 300 also contains a browser program module (not illustrated) and a data exchange module 245 for accessing external data. The system has a speaker 352, display 353, as well as a printer 354, which can be connected directly to the I/O backplane 350.

“In certain embodiments, the system 300 may be implemented as a standalone device rather than in a network or computer system. FIG. FIG. 3 shows the I/O device 350 connecting to the speaker (spkr), 352, and microphone (mic). Other features could also be connected to it. This device could have a left hand indexing state selectionor 341, a scrolling state chooseor 342, and a righthand indexing selector 343. A right-hand scrolling selector 344 is also possible. indexing state selector 345. An?nth Scrolling state selector 345, an?nth?

“In certain embodiments, the system also includes security measures to protect the subject?s privacy, integrity, or both. These security measures include software and firewalls. The system can also be configured to work in environments that require administrative control and procedures. The system could include an administrative module (not illustrated) that can be used to manage access, configure engines, monitor results and perform quality assurance tests. It also allows for the definition of audiences and target audiences. The system can be safely provided over a network. In some cases, the system can also be coupled to a network. Security measures can help protect the system’s contents from outside intrusions.

“In certain embodiments, the system can be a web-enabled application. It can use, for instance, any Hypertext Transfer Protocol (HTTP), or Hypertext Transfer Protocol over Secure Socket Layer(HTTPS)) that is available to one of its skilled users, such as HTML5. These protocols offer rich experiences for end users by using web 2.0 technologies such as AJAX and Macromedia Flash. The system can be used with Internet Browsers such as Internet Explorer and Mozilla Firefox. The system can be used with certain mobile devices that support HTTP/HTTPS, such as iPhones, PocketPCs and Microsoft Surfaces. The system can be accessed via a Wireless Application Protocol (WAP) in some instances. This protocol can be used to access the system from non-HTTP enabled mobile devices such as Cell Phones and BlackBerries. It also provides an easy interface. Because of protocol limitations, Flash animations have been disabled and replaced by Text/Graphic menus. The system can be accessed in some embodiments using a Simple Object Access Protocol, (SOAP), and an Extensible Markup Language(XML). The system allows third-party and custom applications to query the core database and interact with it by exposing it via SOAP or XML. You could create custom applications that run on iPhones, Java, or other.Net-enabled platforms. The system can be used on any platform, and it will adapt to new platforms as they are developed.

“FIG. “FIG. The method generally involves storing 405 data-stacks on a database that can be connected to a processor. The database can store the data as a plurality or sets of discrete pictures. A navigation engine that can be connected to the CPU and on a not-transitory storage medium is used to index the discrete subsets. Scrolling through the data series with the scrolling module and processor will allow you to select 425 from each independently viewable set of discrete photos. Finally, the navigation device is used to the engine to control the engine allows you to choose 425 of each subsets. Point-free selection can be used to select and scroll 430. This could include: (i) independently selecting and scrolling the desired subset from the independently viewable subsets using an indexing state chooseor, the selected subset indexed for an efficient selection using a pointless, activation of a state selector; and (ii) scrolling through each of the independently viewable subsets of the discrete pictures as a data sequence of the discrete photos with a scrolling selector. A graphical user interface can be used to view 435 images within the data-stack. After that, the processing of the viewing will complete and the user can provide analysis of the images.

“FIG. FIG. 5 shows a prior art navigation device that is used to view a data-stack consisting of images. The device is a mouse with a selection and scroll button. One of skill will be able to appreciate the improved efficiency of the systems, components and devices described herein. In some embodiments, one can view the data stack in less than five percent, at most 10%, at minimum 15%, at best 20%, at worst 40%, or any other range in increments below 1%. Some embodiments increase the viewing time by 5% to 50%. 5% or 30%. 5% or 20%. 5% or 15%. 6% to 40%. 7% to 25%. 10% to 20%. 7%. to 18%. 8%. to 16%. 9%. to 15%. Or any other range in increments of 1%. Some embodiments improve the viewing time by a greater percentage than the second method, such as 5% to 40%, 5% to 10%, 15% or 50%.

“At least substantially” is used in the teachings herein. A value that is not significantly different from the reference value can be used. One value can be at least substantially the same value as a reference value if the standard deviation is not greater than one standard deviation from that reference value.

“The teachings herein are based on the medical field as a platform for discussing the advantages of the presented systems and methods. The teachings herein can be used to view any image data-stack. Some embodiments include radiographs and CT images in the medical image data. Magnetic resonance imaging is sometimes included in some embodiments of medical image data. In some cases, medical image data also includes sonographs. In some cases, the medical data also includes PET images. The teachings provide a method for viewing a data-stack containing medical images quickly and efficiently via a graphical user interface. These systems may include a processor, a database connected to it and on non-transitory computers readable storage media for medical image data. A navigation engine is connected to this processor and to a nontransitory storage medium for indexing each discrete subset of the images. A scrolling module can be connected to and connected to a nontransitory storage medium for assembly of each discrete subset of the images as a data sequence of discrete pictures for scrolling through each subset.

The universal format, as described herein includes PACS image storage and transmission using DICOM (Digital Imaging and Communications in Medicine). Some embodiments include a web-based interface that allows users to access the internet or Wide Area Networks. This could be a VPN (Virtual Private Network), or SSL (Secure Sockets Layer). Some embodiments may include client-side software that uses JAVASCRIPT, ACTIVEX and/or JAVA APPLET. A more robust PACS system that can connect to all the resources of the computer where the PACS system is running on is possible in some embodiments. This system may be able to accommodate frequent Web Browser or Java updates. The PACS system may support DICOM part 18, according to some embodiments. Web Access to DICOM objects (WADO), in some instances, is used to create the standard for exposing images and reports via the internet as a portable medium. The PACS architecture can be cross-platform compatible, which means that WADO can help increase the dissemination of images and reports to patients and referring doctors. In some embodiments, the system also includes an image backup to ensure HIPAA compliance. These embodiments automatically send copies of images from the image database to another computer for offsite storage.

“The teachings contained herein can be used for improving current, state of the-art image analysis systems and procedures, such as PACS systems. The systems, components and devices as well as methods used in this state-of the-art technology are hereby included by reference in all their entirety. For example, Strickland N. H. Arch Dis Child83:82-86 (2000); and Alamu F. O. International Journal of Computer Applications 34(4), 12 (2011). You should know that the current state-of-the art methods can search for and extract images using a dedicated PACS server. For example, you could use DICOM messages to find image attributes and then retrieve them through a?C?FIND?. query and a C-MOVE? query and a?C-MOVE? request. A query could include, for instance, a patient ID and an ID for the PACS user. The server returns a list C-FIND responses. Each response also contains a list DICOM attributes. These are populated with the values for each match. To select images, the user can extract the desired attributes from the response. C-MOVE and C-GET can be used to retrieve the images from the PACS server at the study, series, or image level (set or subset or discrete image). C-MOVE can be used most often within facilities and enterprises, while C-GET is more useful between enterprises. C-MOVE requests specify?where? The images should be sent with an identifier that is known about the destination. This will allow the server to map the destination to a TCP/IP port and address, as well as knowing all destinations in advance. C-MOVE, for example, uses different destinations on separate connections. C-GET on the other hand uses the same connection as the request and does not require that the?server be contacted. Knowing the destination of the TCP/IP address, port, and other information in advance allows for easier working around firewalls and network address translations. This is an environment in which C-MOVE messages might not be able to pass through. Other retrieval mechanisms such as WADO, WADO WS, and most recently WADO RS can be used in some embodiments. This is especially useful for cross-enterprise usage. These systems, components, devices and methods, which are described herein, at minimum speed up navigation of images using the state-of the-art systems. They efficiently handle image selection and review as well as reduce repetitive movements that result from the standard point-and click navigation devices.

To facilitate the independent selection and mapping discrete images to allow for efficient viewing and retrieval of them, the method may include giving each image its own identification means to provide a “linking mechanism”. The navigation device can be used to link the images and sets, subsets and discrete images. This allows for quick and efficient indexing. The means of identifying a discrete or set image can include any parameter that can help in filtering the images or parsing them. Some embodiments allow for the use of any number of criteria to parse or filter the images, including image type such as imaging technology, body part or objects imaged, position of the image within that body part or object and time imaged. Also, the subject can be identified, possibly including details about the subject such as name, age and sex, gender, ethnicity and disease, genomic markers or other correlating diagnostics. The indexing step may also include additional indexing/identification of each discrete image for an independent selection, such as one image or a custom-designed group of images. Some embodiments provide images with an alphanumeric identifier or bar code or another known method of identification. The identifiers may provide an indexing mechanism or linking mechanism that allows the user to identify a particular data-stack or set within it. Or a discrete image within it.

“FIGS. 6A-6D illustrate a ?point-and-click-free? Some embodiments describe the process of looking at images in a data-stack through the eyes of a user. FIG. FIG. 6A shows a graphic user interface 605 that allows the user to select from 610 images using the indexing state selector. This is done without the need for a point-and click motion. FIG. FIG. 6B shows a graphic user interface 605 that has a subset 615 from set 610 of images. The user can select the indexing state without having to use a point-and click motion. FIG. FIG. 6C shows a graphic user interface 605 that allows the user to select discrete images 615 from subset 610 of images. Each image can be selected by the user using a scrolling state selector. The scrolling state selector allows the user to view the selected images without the need for a point-and click motion. FIG. FIG. 6D is a graphical user interface 605 that displays a selected, discrete image. This image represents the best of the select images 620 in FIG. 6C. The desired image 625 may be one image within the select, distinct images 620 or the result of the user altering or enhancing the image in order to diagnose or display a disorder 630 in the select images 620. The desired image may be an average of several of the select, discrete pictures 620. The desired image may be digitally enhanced from one of the selected, discrete images (620), such as brightness enhancement, contrast enhancement, brightness enhancement, noise removal, or the difference between an image subtraction and another image in the data stack.

“In some embodiments, the unique identifiers or identifiers provide enough variation or permutations among images so that every image will have its own unique identifier among all of them. Each image can be unique among all images in an image database for a period of one month, six months, two years, five years, ten years, ten years, twenty years, 50 years or 100 years. The image database can be a master image storage system accessible via downstream computing systems using a computer network, such as the intranet or internet. The indexing state selector can also be modified to allow for a quick, efficient, one-click indexing of sets, subsets and discrete pictures. A scrolling state selector allows the user to scroll through the sets and subsets to discrete images. This reduces repetitive motions.

“FIG. “FIG. 7 shows a flowchart that illustrates the more complicated, slower and less intuitive point-and-click method for viewing a data-stack. This method may include storing 705 a dataset on a database that can be connected to a processor. The database can also be stored on a nontransitory computer-readable storage medium for storing data. Scrolling 727 through the Sagittal Series of Images, moving 728 the mouse and selecting an Axial Series of Images, pointing at an image representing the series and clicking on it to select; scrolling 729 through an Axial Series of Images, moving the cursor to select discrete Axia images, using the images and then clicking to review 730 of the images. Levels in the data-stack. Then, 740 the moving and pointing and clicking. Scrolling, clicking, and clicking for the rest of the?n. levels in the data stack.”

FIG. “As can be seen in FIG. The repetitive use of point-and click motions is laborious. One skilled person will recognize that the teachings herein improve efficiency by at least selecting sets, subsets and discrete images. This results in lower repetitions and, in some instances, elimination of the need for point-andclick on the graphical interface.

“To clarify and contrast the current state-of the-art with these teachings, the images in a state of the-art PACS display used in current image navigation are grouped into “stacks”. a series of images that are related. A stack of images can be linked by an imaging plane (e.g. axial, coronal, or coronal), reconstruction algorithm, bone, soft tissue, and brain. Other criteria. Point-and-click is used to select the images in a series. Then, scroll up and down with the mouse wheel to navigate in a linear fashion. Point-and-click combined with the mouse wheel results in repetitive motions that can lead to repetitive stress injuries. These systems, components and devices reduce time-related injuries and occupational costs caused by navigational limitations. They also provide a direct-selection mechanism which eliminates the need to click and point-and-click. While point-and-click may be available for the navigation device in certain embodiments, it is not necessary. The navigation device may include a scrolling platter, along with a series one-click buttons that correspond to specific locations in a data stack. The navigation device may include a number of scrolling platters that correspond to particular sets or subsets of discrete images and a series of one-click buttons that correspond to specific locations within the data-stack. In some embodiments, the navigation devices include a scrolling platter, a series of one click buttons, and a second scrolling plate, which corresponds to a graphical user interface. The systems described herein may be configured in many ways that are ergonomically and time-saving.

“FIG. “FIG. 8 shows a system that includes a direct-selection bilateral navigation device according to certain embodiments. The bilateral system 800 has two diagnostic monitors 805. Each monitor 805 is in operable communication to a navigation device 855 that is a rotating platter. A linking mechanism 860 (indexing selector), which is parsed into a plurality one-click buttons that directly link to equal parsed groups or?series of image stacks, is also included. The scrolling state chooseor 855 on the left and indexing selector 840 on the right can both be controlled by the left hand. However, the scrolling selector 855 on the right and indexing selector 840 on the right can be controlled with the right hand. Each monitor 805 displays stacks of images that have been grouped into series (Se 1, Se 2, Se 3 and Se 4 on the left monitor 805 respectively; and Se 5, Se 6, Se 7 and Se 8 on 805, respectively).

“FIG. “FIG. 9 shows the dynamics of using a system that includes a bilateral, direct selection navigation device. The bilateral system 900 has the left monitor 905 linked to the left scrolling selector 955, and left indexing selector 960 ergonomically placed for control with the left hand. In turn, the right monitor 905 is linked to right scrolling selector 955, and right indexing selector 960 ergonomically placed for control using the right hand. The button locations on each indexing state selector 960 correspond to the selection to and linkage of the desired series on the left and right monitors. These are then navigated using the appropriate left or right scrolling states selector 855. FIG. 9: Pressing button 2 will link left platter to series 2 (Se2), while pressing button 5 will link right platter to series 5 (Se5). The controls remain linked until the user changes them.

“In some embodiments, the order of series can be set by either a default selection or a user-created selection. A default order of review in software may be sequential. In this case, the user will view images in Se 1, Se 2, and Se 3. You can configure a custom-designed user selection to display the images in a different order. For example, Se 1, Se 2, Se 3 and Se 4. Perhaps the user prefers to switch between the left and right screens to balance their use of left and right hands during the day. For example, Se 1, Se 5, Se 6, Se 3, Se 7, Se 8, and so forth.

“In certain embodiments, where a point and-click mouse is part the system, once a series is linked with a scrolling state selector such as a platter and series, the user can point and-click the mouse on either screen. The left platter will lock-into scrolling strictly in accordance to the series currently index through the linking mechanisms on the left side monitor and the right platter will remain locked-into Scrolling strictly according the series currently index through the linking mechanisms on the right side monitor. This linking is independent of mouse position and allows the mouse to be used as an optional “third control”. This allows you to select a single image occasionally without having to scroll from one of the monitors. As a random selection monitor, a third monitor is possible. This flexibility can be achieved by using a mouse as an accessory tool in certain embodiments.

“FIG. “FIG. 10 shows a system with bilateral monitors. At least one monitor can have a plurality scrolling state selectors or linking state selectors according to certain embodiments. This illustration shows how multiple scrolling and linking mechanisms can be used on one monitor. FIG. FIG. 10 shows that the system 1000 includes a pair of monitors 1005 as well as a navigation device 1050. The monitor 1005 to the left (1) contains a single scrolling selector 1055, and a single indexing selector 1060 which are linked to each scrolling selector 1055. The right monitor 1005 has two (2) scrolling state chooseors 1055, and a plurality (2) of indexing selectors 1060 linked to the plurality (3) of scrolling selectors. You can select the controlling platter (2,3) and the linking mechanism for right monitor 1005 by using a button that can either be used separately or shared with a state chooseor. The platter (2-3) can be pushed to select the platter (2-3) and view the series associated to that platter at any time.

“FIG. “FIG. 11” illustrates a system with three monitors. Each monitor has its own platter and linking mechanism according to certain embodiments. This illustration shows how a plurality series can be linked using a plurality indexing state selectors in an one-to-one relationship. It also includes a plurality scrolling state selectors and monitors. This system reduces complexity, simplifies viewing and inherently reduces fatigue. The system 1100 includes three monitors 1105 (1 to 2) and 3 (3 to 3), each with their respective scrolling state selectors. FIG. FIG. 11 shows how a plurality of platters are combined with linking mechanisms into one navigation device 1150. It has scrolling state selectors 155 and indexing selectors 160. However, each navigation device can be used independently, which allows for easy positioning with any monitor. This configuration may be desirable to one of the skilled because it allows you to separate common view series onto their own screens. For example, (1) posterior-anterior; (2) lateral; (3) oblique; (1), axial; (2) coronal; (3) sagittal. A skilled person will appreciate the time and effort saved by having related series open with separate controls. This could translate into increased production and less repetitive motions, which in turn would reduce repetitive stress injuries.

The mouse scroll wheel can be used to compare relative repetitive movements between the platter and the mouse. If the distance traveled by a user’s fingers around (i), the circumferences of the scrolling wheels of the mouse and (ii), the platter circumferences are equal, and likewise, the distance/time of information movement across the monitor, then it is possible to compare the relative repetition of movements between the mouse wheel or the platter. We can assume that the average diameter of a mouse scrollwheel is between 0.75 and 1.25 inches. The average platter diameter is about 3.0 to 7.0 inches. To measure the distance traveled by the mouse scroll wheels across a monitor, we can use a similar method to that of a surveyor’s tool to determine the distance traveled on the ground relative to the distance traveled using the platter. The following table, Table 1, on scrolling efficiency uses this method, and assumes a 1:1 circumference:distance across the monitor, to compare the repetitions required to travel from top to bottom of a 17 inch computer screen (measured diagonal, corner-to-corner) with an aspect ratio of 16:10 (height:width), which is a distance of about 14 inches.”

“TABLE 1\nMouse scroll wheel Platter scrolling\nstate selector state selector\nDiameter (inches) 0.75 1.25 3.00 7.00\nCircumference (inches) 2.355 3.925 9.42 21.98\nTactile surface exposed 0.77 1.30 100% 100%\n(inches); distance per\nstroke (assume 33% of\nwheel circumference)\nRepetitive motions to 18.18 10.77 1.49 0.64\ntravel 14 inches = strokes strokes rotations rotations\n14/distance per stroke\nExcess repetitions of 18.18/ 10.77/\nmouse wheel over platter 0.64 = 0.64 =\n28.4x 16.8x\n18.18/ 10.77/\n1.49 = 1.49 =\n12.2x 7.2x”

“FIG. “FIG. 12 illustrates a system with?n? 12 illustrates a system with?n? monitors each having its own platter and linking mechanism according to certain embodiments. This illustration shows how a plurality series can be linked using a plurality indexing state selectors in an one-to-one relationship. It also includes a plurality scrolling state selectors and monitors. The figure shows that each monitor can be linked to a navigation device independently, depending on the subjective preferences. This system is simple to use, reduces complexity, and can be used to reduce fatigue. The system 1200 has the following features: Monitors 1205 (1. 2,. . . n) with the respective scrolling state selectors. FIG. FIG. 12 shows how a plurality of platters are combined with linking mechanisms to create one navigation device 1250. It has scrolling state selectors 1255, indexing state selectors 1206, and can also be used as an individual navigation device or subgroup of devices, which allows for easy positioning with each monitor. This configuration may be desirable to one of the skilled because it allows you to separate a number of common view series or uncommon view series on your own dedicated screens. . . You can view a series of images within a data-stack or simultaneously view series on multiple body regions, such as in a study to determine the spread of trauma in trauma patients or metastasis in cancer patients. You might also be able to simultaneously view series using more than one imaging technology such as CT or MRI, ultrasound, and so on. A skilled person will be able to see how having related series open with separate controls for each series would result in significant time savings, which could translate into production, as well as a reduction of repetitive motions that can lead to repetitive stress injuries.

“FIG. “FIG. 13” illustrates different embodiments of the indexing selector according to certain embodiments. The navigation device 1350 includes scroll inputs or scrolling state selectors1355 and a linking mechanism or indexing state choosers1360. The indexing state chooseors 1360 in this embodiment are buttons 1360 that can be linked to separate sets of images or subsets of images. Any one of the skilled will know that there are other technologies that can be used to link to separate sets of images, subsets, or discrete pictures. Gaze detection 1360b is an example of a technology that allows the navigation device detect whether a user is looking at one particular monitor. It can also determine whether the individual sets of images, subsets or discrete images are visible. The device will display the target of the user’s gaze if it detects that they are looking at the screen, independent sets of images or subsets of images. Gaze technology can trigger an automatic timer in dwell module. This will cause a timed scrolling to be initiated. The scrolling may stop when the device detects the user is looking away from the monitor or any of the independent sets, subsets, or discrete images on the monitor. When the device senses that the user is looking again at the device, the scrolling may be resumed. The buttons on the linking mechanism could also be used to select another state selector 1360c, such an indexed knob, switch or rotary selection device. The system can also index images using a preset protocol 1360d. This can be an autoselection that is based upon desired series parameters. It can also be used as a default setting such as axial, sagittal, and coronal images. You can also show axial images on one monitor and sagittal views on the other. Coronal views are shown on third monitor. The indexing mechanism doesn’t require a push button. In some cases, a vocal command 1360e is sufficient.

“FIG. “FIG. 14 illustrates different embodiments of the scrolling selector, according some embodiments. Scroll inputs or scrolling state selectors 1455 are part of the navigation device 1450. A linking mechanism or indexing state choosers 1460 is also part of the device. The scrolling state selectors 1455 in this embodiment are platters 1455 that can be linked to separate sets of images or subsets of images. The ability to link directly to separate sets of images, subsets, or discrete images for scrolling can be achieved with other technologies. You can use a slider switch/fader 1455b or a tactile scrolling surface 1455c, such as a finger treadmill. Alternately, the buttons of the linking mechanism could be any type of state selector 1360c, such an indexed knob, switch or rotary selection device. The system can also scroll images based upon a preset protocol. This can be an auto scroll based on series parameters that can be individually selected for each case or a default setting such as a scroll speed for axial views, scroll rates for sagittal views and scroll rates for coronal views. You can also set a scroll speed for each monitor. The scrolling mechanism doesn’t require a push of a button. In some cases, a vocal command is sufficient to change the scrolling speed.

The systems and methods described herein allow for the viewing of image data on a handheld device. However, the CPU of a handheld computer system can have problems concurrently processing audio data files. A handheld computing system might experience latency problems in some instances. As such, data files may require compression. In some cases, data files may need to be compressed with a compression technique such as QUICKTIME from Apple. You can also use other file compression techniques. In some cases, IMA4 can be used to compress files. The system will require a minimum of a 600-700MHz processor in some instances. A 400 MHz processor might be used by an older APPLE system, but a more modern system can use a 1300 MHz CPU. For example, the IMA4 compression method reduces audio file size to 25%. SMPTE, DIRAC and HEVC are all examples of video compression. It should be noted that some embodiments can also use uncompressed wave files. Due to the faster processors available, many home computers may not require compressed files. The computer system’s bandwidth, i.e. The size of the CPU, memory and other components will determine whether compression is required. A skilled person in the art will recognize that some compression technologies may be required in certain systems in order to achieve optimal performance. These technologies can also be easily identified and accessible.

“FIG. 15. This shows, in accordance with some embodiments, how a network can be used to support the system. A network 1505 is a way to connect multiple computer systems together, such as the internet and cellular networks. The term “internet” is used herein. The term “internet” as used herein refers a network that uses protocols such the TCP/IP protocol and possibly other protocols like the hypertext transfer protocol for hypertext markup languages (HTML) documents. Those skilled in the art are familiar with the physical connections and protocols and communication procedures that make up the internet.

Access to the internet 1505 can be provided by internet service providers (ISP), like the ISPs 1510 or 1515. Client systems such as 1530, 1550 and 1560 have access to the internet via the ISPs 1510, 1515. Client computer system users can access the internet to view, send and exchange information. These documents are often made available by web servers such as web server 1520, which is considered to have?on?. The internet. These web servers are often provided by ISPs like ISP 1510. However, a computer system can also be connected to the internet and set up without the need for an ISP.

“The web server 1520 typically consists of at least one computer system that acts as a server computer system. It is set up to work with the protocols of worldwide web and is connected to the internet. Optionally, the webserver 1520 may be part of an ISP that provides internet access for client systems. The web server 1520 can be seen coupled to the 1525 server computer system. This is also coupled to web content 1595 which can be considered a type of media database. FIG. shows two computer systems 1520, 1525. 15. The web server system 1520 is shown in FIG.

“Cellular network Interface 1543 is an interface between a cell network and the corresponding cellular device 1544, 1546, and 1548 on the one side and network 1505 on both sides. Cellular devices 1544-1546 and 1548 can connect to network 1505 to exchange information, such as email, content or HTTP-formatted files. Cellular network interface 1543 can be coupled to computer 1540. This connects to network 1505 via modem interface 15.45. Computer 1540 can be used as a gateway, personal computer, or server computer. Computer 1540 could be similar to client computers 1550 or 1560, or to gateway computer 15,75. The connection between interface 1543, computer 1504, and modem 1545 allows software or content to be uploaded or downloaded.

Client computer systems 1530-1550 and 1560 can view HTML pages from the web server 1520 using the appropriate web browser software. The ISP 1510 provides internet connectivity for the client computer systems 1530 and 1550 through the modem interface 1505, which can also be considered part the client computer network 1530. A client computer system could be a personal, network, or other type of computer system.

“Similarly, the ISP1515 provides internet connectivity to client systems 1550-1560. However, as illustrated in FIG. 15 connections are different from those for computers that are directly connected. Client computer systems 1550, 1560 form part of a LAN that is connected through a gateway computer 1575. FIG. FIG. 15 illustrates interfaces 1535, 1545 generically as a “modem”,? Each interface can be an analog, isdn, or satellite modem. ?direct PC? ), or any other interfaces that allow a computer system and other computers to be connected.”

Client computer systems 1550, 1560 can be coupled to a LAN1570 via network interfaces 1555 or 1565. These interfaces can be ethernet networks or other network interfaces. A gateway computer system 1575 is also connected to the LAN 1570, which provides firewall and other internet-related services for the local network. The gateway computer system 1575 can be coupled to the ISP1515 to provide internet connectivity for the client computers 1550 and 1560. The gateway computer system 1575 may be a traditional server computer system. The web server system 1520 is also a traditional server computer system.

“Alternatively, a server computer 1580 can be connected to the LAN 1570 via a network interface 1585. This allows clients 1550, 1560 to access files 1590, and other services 1590, without needing to connect to internet through the gateway 1575.

The system can provide social networking by allowing users to contact each other through such a network. The system may include a messaging module that can send notifications via SMS, email, or other media. The system can be accessed through a portable single-unit device in some embodiments. In other embodiments, the input device and graphical user interface are provided via a single portable unit device. The portable, single-unit device can be a handheld device in some instances. The systems and methods may operate from the server and user to one another, or from the user and a server and from one user to the other, or from one user to the server and from one user to the server and from one user to the server and from one user to the server and from one user to the server and from another user to the server and from one user to the server and from one user to the teacher (or plurality if teachers), or from one server to several users and a conductor. Interactions can take place through real-time users. These interactions may be available in a forum that is either public, private or semi-private or member-only. Or, they can not be real-time such as a user to a server to a plurality of users and a teacher (or plurality of teachers). An example of an environment that isn’t real-time is a blog-type or message room.

“A real-time environment responds to communications within a set time constraint, or?deadlines?” For example, real-time responses can be provided in milliseconds or microseconds. They can range from 0.01 milliseconds up to 999 milliseconds. 0.03 milliseconds up to 600 milliseconds. 0.04 milliseconds up to 600 milliseconds. 0.06 milliseconds down to 400 milliseconds. 0.08 milliseconds up to 300 milliseconds. 0.07 milliseconds up to 400 milliseconds. 0.08 milliseconds.10 to 10 to 10 milliseconds. The system responds in some cases without any noticeable delay. The network can be configured to send text and/or sound for real-time messaging and posting of messages, instructional posts, news postings, or other items that are of interest to users.

“A network can also include traditional media to allow users and the public to communicate. This includes satellite, optical fiber, satellite and television cable. These digital information can be sent to users. This will allow you to use the information provided in this article with traditional media channels. Some embodiments allow the systems, components and devices to be used to provide non-confidential data, which is information in which confidentiality has been legally waived. This allows for information sharing over the network.

The following examples illustrate the use of the teachings. The examples are intended to illustrate the principles and should not be taken as limiting.

“Example 1. “Example 1.

This example shows how long it takes to analyze a set thoracic or abdominal cases with a traditional mouse control and an ergonomic keyboard. It also compares the time taken by a traditional mouse control that uses a point-and click mouse control, and an ergonomic keyboard that has scrolling and indexing controls such as a scrolling state selector and an indexing state selector. Comparative studies were conducted on three (3) thoracic and three (3) abdominal cases. Images from the thoracic studies were broken down into 400-419 images that showed axial, coronal and sagittal views. The data stacks for abdominal studies included 415-465 images, divided into 4 subsets showing axial, coronal and sagittal views. This example’s results are shown in Table 2.

“TABLE 2\nMethod\nTraditional Ergonomic Traditional Ergonomic\npoint-and- index-and- point-and- index-and-\nclick scroll click scroll\nRegion\nAbdominal Thoracic\nRun 1 3.37 2.75 4.25 3.53\n(minutes)\nRun 2 3.83 3.08 4.50 3.68\n(minutes)\nRun 3 4.25 3.58 4.08 3.48\n(minutes)\nRun 1 0.62 0.72\ntime saved\n(minutes)\nRun 2 0.75 0.82\ntime saved\n(minutes)\nRun 3 0.67 0.60\ntime saved\n(minutes)\nAVG 41 43\ntime saved\n(seconds)\nST DEV 3.9 6.6\ntime saved\n(seconds)”

The ergonomic system can save you time statistically, as shown in the following example. This time savings can translate into less repetitive motions and less repetitive stress injuries for the radiologists, as well as a more productive day. The time savings can also lead to a better focus by the radiologist on the readings, which may result in higher-quality diagnoses. The term “higher quality” may be used in some instances. The term “higher quality” can also refer to a decrease in reading errors. These errors can be reduced by at minimum 50%, at most 40%, at best 30%, at worst 20%, at worst 10%, and at most 5% in certain embodiments. The term “higher quality” may be used in some embodiments. The term “higher quality” can refer to an increase or identification of diseases or disorders. In some embodiments, the increase can be as high as 50%, 40%, 30%, 20%, 10% or 5%.

“Example 2. “Example 2.

This example shows how a dwell module is used to control the speed or dwell time at which a radiologist reviews one or more images within a data-stack. It may be beneficial to control and/or monitor the speed at which images are reviewed by subgroups, groups, or individual images. This may also be advantageous from the standpoint of providing timely services.

Click here to view the patent on Google Patents.

What is a software medical device?

The FDA can refer to software functions that include ” Software As a Medical Device” and “Software in a Medical Device(SiMD)”, which are software functions that are integral to (embedded in a) a medical device.

Section 201(h),?21 U.S.C. 321(h),(1) defines a medical device to be?an apparatus, implements, machine, contrivances, implant, in vitro regulator, or other similar or related articles, as well as a component or accessory. . . (b) is intended for diagnosis or treatment of disease or other conditions in humans or animals. (c) Is intended to alter the structure or function of human bodies or animals. To be considered a medical device, and thus subject to FDA regulation, the software must meet at least one of these criteria:

• It must be used in diagnosing and treating patients.
• It must not be designed to alter the structure or function of the body.

If your software is designed to be used by healthcare professionals to diagnose, treat, or manage patient information in hospitals, the FDA will likely consider such software to be medical devices that are subject to regulatory review.

Is Your Software a Medical Device?

FDA’s current oversight, which puts more emphasis on the functionality of the software than the platform, will ensure that FDA does not regulate medical devices with functionality that could be dangerous to patient safety. Examples of Device Software and Mobile Medical Apps FDA is focused on

• Software functions that aid patients with diagnosed mental disorders (e.g., depression, anxiety, and post-traumatic stress disorder (PTSD), etc.) by providing “Skill of the Day”, a behavioral technique, or audio messages, that the user can access when they are experiencing anxiety.
• Software functions that offer periodic reminders, motivational guidance, and educational information to patients who are recovering from addiction or smokers trying to quit;
• Software functions that use GPS location data to alert asthmatics when they are near high-risk locations (substance abusers), or to alert them of potential environmental conditions that could cause symptoms.
• Software that uses video and games to encourage patients to exercise at home.
• Software functions that prompt users to choose which herb or drug they wish to take simultaneously. They also provide information about interactions and give a summary of the type of interaction reported.
• Software functions that take into account patient characteristics, such as gender, age, and risk factors, to offer patient-specific counseling, screening, and prevention recommendations from established and well-respected authorities.
• Software functions that use a list of common symptoms and signs to give advice about when to see a doctor and what to do next.
• Software functions that help users to navigate through a questionnaire about symptoms and to make a recommendation on the best type of healthcare facility for them.
• These mobile apps allow users to make pre-specified nurse calls or emergency calls using broadband or cell phone technology.
• Apps that allow patients or caregivers to send emergency notifications to first responders via mobile phones
• Software that tracks medications and provides user-configured reminders to improve medication adherence.
• Software functions that give patients access to their health information. This includes historical trending and comparisons of vital signs (e.g. body temperature, heart rate or blood pressure).
• Software functions that display trends in personal healthcare incidents (e.g. hospitalization rates or alert notification rate)
• Software functions allow users to electronically or manually enter blood pressure data, and to share it via e-mail, track it and trend it, and upload it to an electronic or personal health record.
• Apps that offer mobile apps for tracking and reminders about oral health or tools to track users suffering from gum disease.
• Apps that offer mobile guidance and tools for prediabetes patients;
• Apps that allow users to display images and other messages on their mobile devices, which can be used by substance abusers who want to quit addictive behaviors.
• Software functions that provide drug interaction and safety information (side effects and drug interactions, active ingredient, active ingredient) in a report based upon demographic data (age and gender), current diagnosis (current medications), and clinical information (current treatment).
• Software functions that allow the surgeon to determine the best intraocular lens powers for the patient and the axis of implantation. This information is based on the surgeon’s inputs (e.g., expected surgically induced astigmatism and patient’s axial length, preoperative corneal astigmatism etc.).
• Software, usually mobile apps, converts a mobile platform into a regulated medical device.
• Software that connects with a mobile platform via a sensor or lead to measure and display electrical signals from the heart (electrocardiograph; ECG).
• Software that attaches a sensor or other tools to the mobile platform to view, record and analyze eye movements to diagnose balance disorders
• Software that collects information about potential donors and transmits it to a blood collection facility. This software determines if a donor is eligible to collect blood or other components.
• Software that connects to an existing device type in order to control its operation, function, or energy source.
• Software that alters or disables the functions of an infusion pump
• Software that controls the inflation or deflation of a blood pressure cuff
• Software that calibrates hearing aids and assesses sound intensity characteristics and electroacoustic frequency of hearing aids.

What does it mean if your software/SaaS is classified as a medical device?

SaaS founders need to be aware of the compliance risks that medical devices pose. Data breaches are one of the biggest risks. Medical devices often contain sensitive patient data, which is why they are subject to strict regulations. This data could lead to devastating consequences if it were to become unprotected. SaaS companies who develop medical devices need to take extra precautions to ensure their products are safe.

So who needs to apply for FDA clearance? The FDA defines a ?mobile medical app manufacturer? is any person or entity who initiates specifications, designs, labels, or creates a software system or application for a regulated medical device in whole or from multiple software components. This term does not include persons who exclusively distribute mobile medical apps without engaging in manufacturing functions; examples of such distributors may include the app stores.

Software As Medical Device Patenting Considerations

The good news is that investors like medical device companies which have double exclusivity obtained through FDA and US Patent and Trademark Office (USPTO) approvals. As such, the exit point for many medical device companies is an acquisition by cash rich medical public companies. This approach enables medical devices to skip the large and risky go-to-market (GTM) spend and work required to put products in the hands of consumers.

Now that we have discussed the FDA review process, we will discuss IP issues for software medical device companies. Typically, IP includes Patents, Trademarks, Copyrights, and Trade secrets. All of these topics matter and should be considered carefully. However, we will concentrate on patents to demonstrate how careless drafting and lack of planning can lead to problems, namely unplanned disclosures of your design that can then be used as prior art against your patent application.

In general, you should file patent application(s) as soon as practicable to get the earliest priority dates. This will help you when you talk to investors, FDA consultants, prototyping firms, and government agencies, among others. Compliance or other documents filed with any government agency may be considered disclosure to third parties and could make the document public. In general, disclosures to third parties or public availability of an invention trigger a one year statutory bar during which you must file your patent application. Failure to file your application within the required time frame could result in you losing your right to protect your invention.

The information from your FDA application may find its way into FDA databases, including DeNovo, PMA and 510k databases and FDA summaries of orders, decisions, and other documents on products and devices currently being evaluated by the FDA. Your detailed information may be gleaned from Freedom of Information Act requests on your application. This risk mandates that you patent your invention quickly.

When you patent your medical device invention, have a global picture of FDA regulatory framework when you draft your patent application. Be mindful of whether your software/SaaS application discusses the diagnosing and treating patients or affecting the structure or function of the body and add language to indicate that such description in the patent application relates to only one embodiment and not to other embodiments. That way you have flexibility in subsequent discussions with the FDA if you want to avoid classification of your software/SaaS/software as a medical device. In this way, if you wish to avoid FDA registration and oversight, you have the flexibility to do so.

An experienced attorney can assist you in navigating the regulatory landscape and ensure that you comply with all applicable laws. This area of law is complex and constantly changing. It is important that you seek legal advice if you have any questions about whether or not your software should be registered with FDA.

Patent PC is an intellectual property and business law firm that was built to speed startups. We have internally developed AI tools to assist our patent workflow and to guide us in navigating through government agencies. Our business and patent lawyers are experienced in software, SaaS, and medical device technology. For a flat fee, we offer legal services to startups, businesses, and intellectual property. Our lawyers do not have to track time as there is no hourly billing and no charges for calls or emails. We just focus on getting you the best legal work for your needs.

Our expertise ranges from advising established businesses on regulatory and intellectual property issues to helping startups in their early years. Our lawyers are familiar with helping entrepreneurs and fast-moving companies in need of legal advice regarding company formation, liability, equity issuing, venture financing, IP asset security, infringement resolution, litigation, and equity issuance. For a confidential consultation, contact us at 800-234-3032 or make an appointment here.