This website uses cookies to ensure you have the best experience. Learn more

Data Storm Project: Developing Integrated Real Time Monitoring Framework For Cloud Based Systems

588 words - 2 pages

DataStorm project is developed by University of Stavanger (UiS) and Stanford University (SU) and is based on previous BioSTORM project. It aims at developing integrated real-time monitoring framework for cloud-based systems.

BioSTORM (Biological Spatio-Temporal Outbreak Reasoning Module) project created ontology-driven framework for developing JADE agent systems. Project demonstrated that rich modeling environment that allowed for declarative model definition and its validation was a success in disease outbreak detection modeling. From the time BioSTORM was started streams of data to be analyzed have been rapidly increasing in size and amount. JADE-based deployment become a bottleneck of the framework.

Last year, UiS (with CloudCom.org) and SU have started creating new framework called DataStorm to address the problem of the previous version. Two main goals were: using Hadoop as a main deployment platform and restructuring the framework to facilitate generic data analysis. Initial version of the new framework is described in papers An Ontology-driven Framework for Deploying Cloud-based Systems (submitted for publication at The 2010 IEEE 3rd International Conference on Cloud Computing – CLOUD 2010) and An Integrated Ontology-based Framework for Intelligent Real-time Data Monitoring (submitted for publication at The First International Workshop on Cloud Computing Interoperability and Services – InterCloud 2010). It is planned to be released as open-source afterwords.

Test version runs on small 15 nodes Hadoop cluster at UiS with accessing nodes at UiS and SU. However, we have come to recognize that using Amazon Web Services (AWS) could improve efficiency off the framework, make it available to greater amount of researchers that do not want or are not able to run their own clusters and make collaboration between group of researchers easier.

Our current research plan consists of investigating Amazon CloudFront as a way to provide efficient and low latency...

Find Another Essay On DataStorm Project: Developing Integrated Real-Time Monitoring Framework for Cloud-Based Systems

Embedded Computer Systems Real Time Operating System Characteristics

2708 words - 11 pages is produced. If the timing constraints of the system are not met, system failure is said to have occurred."Examining existing RTOS reveals how real-time systems are implemented. There are dozens of real-time systems available for different platforms. Many manufacturers simply state that their operating systems are real-time without explaining how this is accomplished. One real-time system, QNX, offers more insight, however. This operating system

Developing a Framework for Cyberlaw Essay

1863 words - 7 pages Developing a Framework for Cyberlaw Suppose you wanted to witness the birth and development of a legal system. You would need a large, complex social system that lies outside of all other legal authorities. Moreover, you would need that system somehow to accelerate the seemingly millennial progress of legal development, so you could witness more than a mere moment of the process. The hypothetical system might seem like a social scientist's

Cloud Computing Slutions for Electrical Measuring Systems

538 words - 3 pages the state of the system at a given point in time. Rather, the data should provide an acceptable estimate of the system state real-time. In other hand, RTU/SCADA systems located inside the electrical panel or substations and cannot scale and evolve to support next-generation intelligence and modern data communication methods for online analytic platforms such as cloud. The cloud is becoming an increasingly essential part of operating in industry

Project Management for Information Systems

3569 words - 14 pages on time and budget (Wee, 2000). For successful implementation of projects three basic requirements should be met: a clear business objective, understanding of the nature of change and understanding of the project risk (Bailey, 1998). Information Systems Planning Models Project managers may choose to design and build systems using existing IS planning models/methodologies which are broadly classified into impact and alignment models

Formal Specification Language for Agent-Based Systems

2663 words - 11 pages SLABS being used for real projects, a possibility exists that a private company, or a government organization might have used SLABS and would not disclosed this information with the outside world. Conclusion SLABS show that the SLABS language and the agent model underlying the language have the following features. (1) SLABS provides the set of language features that are powerful to specify agent-based systems in various agent models and theories

Time-Predictable Network for Real-Time Data-Centric Computing

1290 words - 5 pages to investigate the time-predictable data-centric network based on the research works in the time-predictable field bus, which are utilized to transmit control messages in the control systems [7, 8, 9, 12]. The CAN protocol is firstly widely used in the robot control system design [5, 6] for quite a long time. Thus, several studies on how to guarantee the real-time requirements of messages in the CAN networks are available, providing the

Anthill: A Framework for the Design and Analysis of Peer-to-Peer Systems

1170 words - 5 pages Anthill: a Framework for the Design and Analysis of Peer-to-Peer Systems The Montresor (2000) paper outlines a new approach which is christened Anthill, for designing P2P applications based on comparisons to ant colonies. It continues with proposing a framework to support the development and study of new protocols based on a P2P approach. The paper considers how there are common issues such as security and routing that are applicable to P2P

Selective Encryption Algorithm for Highly Confidential Real Time Video Applications

1126 words - 5 pages 1. Introduction Conventional cryptographic algorithms, which are generally aimed at encrypting like text data (known as Naïve approach) not well suited for video encryption. This is due to the fact that conventional cryptographic algorithms cannot process the large volume of video data in real-time. Selective encryption of the H.264/AVC bitstream puts decoder to fully decode the encrypted video with degradation in video quality. This perceptual

Selective Encryption Algorithm for Highly Confidential Real Time Video Applications

1442 words - 6 pages 1. Introduction Conventional cryptographic algorithms, which are generally aimed at encrypting like text data (known as Naïve approach) not well suited for video encryption. This is due to the fact that conventional cryptographic algorithms cannot process the large volume of video data in real-time. Selective encryption of the H.264/AVC bitstream puts decoder to fully decode the encrypted video with degradation in video quality. This perceptual

A Knowledge -based Approach to Innovation An Application for Project- based Firms

1055 words - 4 pages supplier transfer technology to construction companies demanding process innovations. As they are more market-oriented, product innovation is the main concern for the supplier industries.Often, price-based competition has hindered the innovation process.#Knowledge Resource CooperationEven the project could learn to adapt to the new methods and work environment, organization struggle to strike balance between achievements of short term objective and

Model of Critical Success Factors and Success Criteria for Project and project Management Success in a Developing Country

2107 words - 8 pages who are developing and controlling the project. Here, we are supporting the argument presented by Munns & Bjeirmi (1996) that Iron triangle is a short term measure of success and is more concerned with success of project management. Further it seems inappropriate to hold project team members responsible for success of project as they are concerned with the implementation and control phase of project. Organizational benefits refers to the

Similar Essays

Real Time Dynamic Integrated Outsourced Warehouse System

1392 words - 6 pages develop the Radio-frequency identification (RFID)-multi-agent to support framework of real-time knowledge. The RFID has an ability to solve the dynamic logistics process management problem. In achieving the domain of real-time enterprise in real-time logistics environment, a knowledge-based system (KBS) for real-time logistics enterprise, the RFID must be integrated and mobile technology to replace of real-time knowledge storage, transfer and

Certain Investigations On Real Time Measurement Systems Deploying Vibration Technique For Bone Quality Assessment

616 words - 3 pages bone vibration .The results showed that subjects with less BMD has high acceleration and vice versa • .Two parameters such as Wave velocity and Amplitude ratio are determined from the time domain response curve for both the subject groups and the difference in these parameters with various age groups are also studied and proved using student t-test. • The frequency domain analysis is also done by taking FFT of the response and measuring the

Access Control And Data Updation With At Pre: Attribute Time Based Proxy Re Encryption For Shared Data In Cloud

2111 words - 9 pages CSP will store the data. On receiving a data access request from a user, the CSP will re-encrypt the ciphertext based on attributes, and return the re-encrypted ciphertext. The data owner outsources a set of data to the cloud. Each piece of data is encrypted before outsourcing. The data owner is responsible for determining the access structure for each data, and distributing secret keys to each user. When a user wishes to access data, he will

Compensation Of Temperature Effects On Guided Wave Based Structural Health Monitoring Systems

641 words - 3 pages Compensation of Temperature Effects on Guided Wave Based Structural Health Monitoring Systems C.A. Dana,1, P. Kudela1, W. Ostachowicz1 1Polish Academy of Sciences, Institute of Fluid-Flow Machinery, Gdansk, Poland adancodrut@imp.gda.pl Introduction Structural health assessment of structures based on ultrasonic piezoelectric sensors that have the capability to emit and record Lamb waves has developed greatly in recent years. The point has been