De presentatie wordt gedownload. Even geduld aub

De presentatie wordt gedownload. Even geduld aub

MonetDB spatial Onderzoeksinstituut OTB 2007-10-16 1 MonetDB spatial Een open-source Spatial DBMS Media Plaza/Het gebruik van OS software in GEO-ICT Wilko.

Verwante presentaties

Presentatie over: "MonetDB spatial Onderzoeksinstituut OTB 2007-10-16 1 MonetDB spatial Een open-source Spatial DBMS Media Plaza/Het gebruik van OS software in GEO-ICT Wilko."— Transcript van de presentatie:

1 MonetDB spatial Onderzoeksinstituut OTB 2007-10-16 1 MonetDB spatial Een open-source Spatial DBMS Media Plaza/Het gebruik van OS software in GEO-ICT Wilko Quak

2 Onderzoeksinstituut OTB 2007-10-162MonetDB spatial Overzicht TUDelft / OTB / Sectie GISt / GeoInfoNed Project De spatial DBMS markt. Categorie-en van DBMS gebruikers Intermezzo: spatial DBMS. MonetDB en MonetDB (spatial) De toekomst van MonetDB (spatial)

3 Onderzoeksinstituut OTB 2007-10-163MonetDB spatial GIS technology

4 Onderzoeksinstituut OTB 2007-10-164MonetDB spatial GISt visie Spatial Information Infrastructure (SII), a vision… Heading towards an information society with varying impact on sectors of our economy Impact on the geo-information sector is huge: geo-info and processing can be transported via (wireless) networks and can be combined with positioning Engines of the SII nodes: geo-DBMSs (Data Base Management Systems) filled with geo-data Fair pricing of data and services, no more endless copying of data (and loss of quality/up-to-dateness)

5 Onderzoeksinstituut OTB 2007-10-165MonetDB spatial GISt: scientific/technological goal Central research theme geo-DBMS as ‘glue’ between: 3D spatio-temporal modeling Computational geometry Distributed GI processing Mobile GIS (LBS) Knowledge engineering Ambition: top 1 (3) of geo-DBMS Universities in the world

6 Onderzoeksinstituut OTB 2007-10-166MonetDB spatial Geo Database Management Center TU Delft open R&D center ‘geo-DBMS’ Partnerships with ICT industry: Oracle, ESRI, Bentley ‘Database lab’ and ‘3D GIS/VR lab’ Website for Communication/ documentation Internet GIS

7 Onderzoeksinstituut OTB 2007-10-167MonetDB spatial Met welk onderzoek kan de Sectie GISt bijdragen? Onderzoek naar bruikbaarheid bestaande producten (benchmarken) Wat mist er nog Meedenken met ontwikkelingen Eigen DBMS ontwikkelen als research vehikel: GeoInfoNed Project

8 Onderzoeksinstituut OTB 2007-10-168MonetDB spatial GeoInfoNed – RGI-232

9 Onderzoeksinstituut OTB 2007-10-169MonetDB spatial wie CWI – Leading DBMS experts with MonetDB TUDelft/OTB – Knowledge of spatial processes CycloMedia – Huge dataset and interesting problems RWS/AGI – Large and diverse datasets and interesting problems

10 Onderzoeksinstituut OTB 2007-10-1610MonetDB spatial Wat Is er nog wel ruimte op de markt? Een inventarisatie: Aanbieders Gebruikers We gaan een spatial DBMS bouwen en daar onderzoek mee doen.

11 Onderzoeksinstituut OTB 2007-10-1611MonetDB spatial De spatial DBMS markt (aanbieders) Oracle – Marktleider commerciele segment Informix/DB2 – Prima implemenatie. Niet erg actief PostgreSQL/PostGIS – ‘Marktleider’ open-source SQLServer – komt binnenkort MySQL – open-source, beperkte functionaliteit

12 Onderzoeksinstituut OTB 2007-10-1612MonetDB spatial Spatial DBMS markt (gebuikers) 4 classes: 1. Server Builders: publish spatial data via web server 2. GIS User: Load various datasets and perform complex analyses 3. Data Maintainer: Maintain one core dataset 4. Power Users: All of the above and more

13 Onderzoeksinstituut OTB 2007-10-1613MonetDB spatial Class 1: Web Server Builders Runs under GeoServer You do not really need a DBMS for this (You use a fraction of DBMS functionality) Only one query counts: Find everything within BBOX. Multi-User Small Queries

14 Onderzoeksinstituut OTB 2007-10-1614MonetDB spatial Class 2: GIS users Full fledges GIS is much more powerful but SQL experts might be tempted Main interest is functionality Spend more time on loading data Need a good query optimizer Data mining

15 Onderzoeksinstituut OTB 2007-10-1615MonetDB spatial Class 3: Dataset Maintainers Limited number of queries. 24/7 stability Transactions. Clustering of data after updates is interesting.

16 Onderzoeksinstituut OTB 2007-10-1616MonetDB spatial Class 4: Power users All of the above and more Take time to understand software Run into research problems: Point clouds from laser-scanning Support 3d-volumes Realtime dynamic data

17 Onderzoeksinstituut OTB 2007-10-1617MonetDB spatial Intermezzo: Spatial DBMS Spatial data types Operaties op types Indexeren op types

18 Onderzoeksinstituut OTB 2007-10-1618MonetDB spatial Spatial Data Types Basic types: Point Line Polygon More Complex: 3D, Geodetic Coordinates

19 Onderzoeksinstituut OTB 2007-10-1619MonetDB spatial Spatial Data types volgens OpenGIS Point LineString LinearRing Polygon MultiPoint MultiLineString MultiPolygon

20 Onderzoeksinstituut OTB 2007-10-1620MonetDB spatial Functions op spatial types

21 Onderzoeksinstituut OTB 2007-10-1621MonetDB spatial R-tree puts MBR on object - MBR : minimum bounding rectangle - Object can be of type point, line or region - At lowest (leaf) level objects are grouped to larger MBR’s, which can be grouped (and so on.....) Indexeren spatial types D F E G H J K A C L N M B I A B C D E F GH I J K L M N Branching factor 4 Einde Intermezzo

22 Onderzoeksinstituut OTB 2007-10-1622MonetDB spatial MonetDB Introduction* MonetDB is opens Hardware trends MonetDB design considerations MonetDB architecture *Slides borrowed from CWI

23 Onderzoeksinstituut OTB Hardware Trends 50% p/year: - cpu speed - mem size - mem bandwidth - disk bandwidth 1% p/year: - mem latency 10% p/year: - disk latency

24 Onderzoeksinstituut OTB Latency is the enemy! Commercial DBMS products (oracle, DB2, SQLserver) stem from OLTP roots focus on minimizing random I/Os => depend on latency! MonetDB: built for bulk access optimize CPU and memory performance

25 Onderzoeksinstituut OTB 2007-10-1625MonetDB spatial MonetDB design considerations Multi-model database kernel support Extensible data types, operators, accelerators Database hot-set is memory resident Simple data structures are better Index management should be automatic Do not replicate the operating system Optimize when you know the situation Cooperative transaction management

26 Onderzoeksinstituut OTB 2007-10-1626MonetDB spatial Monet kernels MAPI protocol JDBC C-mapi lib Perl End-user application ODBC PHP Python SQL XQuery MonetDB product family

27 Onderzoeksinstituut OTB 2007-10-1627MonetDB spatial SWOT State-of-the-art SQL & XQuery DBMS; multi-model database support; decomposed storage model; query processing for decision support systems; extensible kernel; multiple APIs;….. strength Triggers and SQL procs missing; XQuery; some overhead in simple SQL queries; MIL scripting; missing GIS module weakness Commercial systems requirements; competition established market; floating interest; development skills and quality awareness threats Unique selling points for advanced applications in multimedia, streaming, covering both small and the large world opportunities GET INSPIRED BY ADVANCED APPLICATIONS

28 Onderzoeksinstituut OTB 2007-10-1628MonetDB spatial MonetDB - Physical data organization Binary Association Tables

29 Onderzoeksinstituut OTB 2007-10-1629MonetDB spatial Spatial MonetDB

30 Onderzoeksinstituut OTB 2007-10-1630MonetDB spatial Spatial MonetDB -- nu Eerste implementatie in volgende release (Q4). OpenGIS implementatie gebaseerd op PostGIS OpenJUMP plugin Shape2MonetDB converter GeoTools Plugin (in ontwikkeling)

31 Onderzoeksinstituut OTB 2007-10-1631MonetDB spatial Spatial MonetDB – de toekomst MonetDB moet het hebben van zijn speciale architectuur. Uitdagingen: Puntenwolken van Laserscanner. Data-minen op grote spatio-temporele datasets. XML-Data. Saaier werk: Testen huidige implementatie debuggen

32 Onderzoeksinstituut OTB 2007-10-1632MonetDB spatial Vragen Discussie

Download ppt "MonetDB spatial Onderzoeksinstituut OTB 2007-10-16 1 MonetDB spatial Een open-source Spatial DBMS Media Plaza/Het gebruik van OS software in GEO-ICT Wilko."

Verwante presentaties

Ads door Google