Difference between revisions of "Cedeus IDE"

From stgo
Jump to: navigation, search
(información útil y documentación)
(List of VMs)
 
(101 intermediate revisions by 3 users not shown)
Line 1: Line 1:
Centro de Desarrollo Urbano Sustentable - CEDEUS
+
'''Centro de Desarrollo Urbano Sustentable - CEDEUS'''
  
http://www.cedeus.cl
+
* Observatory Webpage:
 +
** http://observatorio.cedeus.cl or http://www.datosurbanos.cl
 +
* Other service domains:
 +
** http://datos.cedeus.cl => geonode direct access
 +
** http://pubs.cedeus.cl => omeka direct access
 +
** http://wiki.cedeus.cl => wiki direct access
 +
** http://owncloud.cedeus.cl => owncloud direct access => path to add in OwnCloud client: http://owncloud.cedeus.cl/owncloud/ (not ''https'')
 +
** http://indicadores.cedeus.cl => Indicator webpage direct access
  
#GeoNode Server on CEDEUSGIS1: http://146.155.17.55 : or http://observatorio.cedeus.cl : open to world [http://live.osgeo.org/en/quickstart/geonode_quickstart.html OSGeo Quickstart]
+
'''Technical Configuration'''
#GeoNode Datastore on Lautaro PostGIS VM http://146.155.17.113 (nat, psql'91: 9434) : closed to world
+
* GeoNode WebServer is Cedeusgeonode: http://observatorio.cedeus.cl : open to world [http://live.osgeo.org/en/quickstart/geonode_quickstart.html OSGeo Quickstart]
otros:
+
* GeoNode DataServer is CedeusDB : access is closed to world
#GeoNode test install: http://146.155.17.54 on Lautaro GeoNode VM (bridge) : open to world
+
 
#OpenTripPlanner on Lautaro GeoNode VM: http://146.155.17.54:8080/opentripplanner-webapp/ : open to world
+
[[Libros del Observatorio]]
#OSGeoLive VM on Lautaro (nat, 2222, access via CoRD) : closed to world - powered off
+
  
 
== Funciones de Infraestructuras Científicos de Datos Espaciales ==
 
== Funciones de Infraestructuras Científicos de Datos Espaciales ==
Line 20: Line 26:
  
 
CEDEUS Long term ToDo list:
 
CEDEUS Long term ToDo list:
# [[Cedeus Hardware]] - get computer + server - '''mid Nov. + end Dec'''
+
# [[IDEs de Chile existente]]
#* ToDo: evaluacion propio servidor(es) vs. nube (pro + contra)
+
# [[Cedeus Technical Architecture]]
# [[IDEs de Chile existente]] - '''18.-22. Nov.'''
+
# [[IDE architecture design]] - '''fin de Nov.'''
+
 
#* TODO: security aspects of the IDE (user types, access management options)
 
#* TODO: security aspects of the IDE (user types, access management options)
 
# DOCUMENTO: Borrador de Proyecto -  development plan for future (clients v.2 v.3) - '''15. Dec.'''
 
# DOCUMENTO: Borrador de Proyecto -  development plan for future (clients v.2 v.3) - '''15. Dec.'''
# [[Cedeus software]]
 
#* [[Cedeus Evaluacion de GeoNode]]
 
#* test instalación de GeoNode en mi servidor personal (cedeusgis1) : '''6. Ene - 28. Feb''':
 
#** incluyendo: (i) instalación GeoNode, (ii) instalación y test con BD externa, (iii) test backup GeoNode + (iv) test backup BD, (v) test anadir tiles/datos in GeoExplorer de TileStream, (vi) '''ToDo''': create mi proprio servidor TileStream (similar como OpenQuake.org), (vi) '''ToDo''': instalación en servidores reales
 
 
# ENCUESTA : user and data survey
 
# ENCUESTA : user and data survey
 
#* primero encuesta - hecho en '''Diciembre 2013''' por Nicolas, me mande archivos con la presentación y resultado
 
#* primero encuesta - hecho en '''Diciembre 2013''' por Nicolas, me mande archivos con la presentación y resultado
#* documents to prepare:
+
#* documents to prepare: (i) envisioned types of IDE use, (ii) list of data (themes) that may be in the institute (checklist?), (iii) data that should not be public, (iv) client types => a mindmap exists already!!
#** (i) envisioned types of IDE use, (ii) list of data (themes) that may be in the institute (checklist?), (iii) data that should not be public, (iv) client types
+
 
# DATOS:
 
# DATOS:
 
#* [[Cedeus Base Data]]
 
#* [[Cedeus Base Data]]
#* EPSG Santiago (from OCUC dataset): 32719 (= UTM Zone 19 South), EPSG OSM: 4326
+
#* [[Cedeus Convenios]]
#* what exists
+
#* Notes:
#* access rights
+
#** EPSG Santiago (from OCUC dataset): 32719 (= UTM Zone 19 South), EPSG OSM: 4326
#* stoarge/db structure
+
#** what exists
 +
#** access rights (see GeoNode access options: public, logged-in user, group, user only)
 +
#** stoarge/db structure (defined by storage structure of GeoNode for shapefiles, rasters are stored in web-folder)
 
# [[Cedeus Metadata]]
 
# [[Cedeus Metadata]]
#* TODO: min, nice to have, evaluacion de software para crear (QGIS, ArcGIS, FME etc.)
+
#* [[CEDEUS CSW]]
 
# TYPO DE CLIENTES
 
# TYPO DE CLIENTES
 
#* desktop clients - SIG : TODO inicio de encuesta en los grupos que usan: ArcGIS, QGIS, gvSIG, OpenJUMP, SAGA ...  
 
#* desktop clients - SIG : TODO inicio de encuesta en los grupos que usan: ArcGIS, QGIS, gvSIG, OpenJUMP, SAGA ...  
Line 52: Line 53:
 
*[[accessing server infra]]
 
*[[accessing server infra]]
 
*[[setting up osgeo vm]]
 
*[[setting up osgeo vm]]
*[[setting up geonode]]
+
*[[setting up geonode]] and [[geonode data upload]]
 
*[[backup of geonode]]
 
*[[backup of geonode]]
*[[setting up tilestream]]
+
*[[setting up tilestream]] and [[Setting up Tilestream VM on CEDEUSDB]]
 +
* How to setup [http://docs.geoserver.org/stable/en/user/installation/linux/index.html GeoServer] is described in this blog entry: http://houhongru.com/blog/2013/01/07/How-to-install-GeoServer-on-Ubuntu-12.04/ . However, I am not sure if the install of Oracles Java instead of openJDK is necessary, since, as far as I recall, the OSGeo LiveDVD uses OpenJDK as well. Location of GeoServer will be ''/var/lib/tomcat7/webapps/'' . (Note, I should have a PDF of that in my projects/planyourplace/docs/development/wyp/)
 +
*[[setting up walkyourplace]]
 +
*[[moving the SF wiki]]
 +
*[[installing OTP]] and [[updating OTP graph]]
 +
*[[Setting up Elgg VM on CedeusGeoNode]]
 +
*[[Cedeus DB backups]]
 +
*[[Nominatim for Traffic Accident Database]]
 +
*[[installing CartoDB for CEDEUS]]
 +
*[[installing Omeka for CEDEUS]]
 +
*[[Processing GeoData for CEDEUS]]
 +
*[[Trabajo Cristian]]
 +
**[[Walkyourplace Django]]
 +
**[[Api rest WalkYourPlace]]
 +
 
 +
== List of VMs ==
 +
 
 +
[[PUC Server Ports]]
 +
 
 +
'''on CedeusGeoNode:''' (see also script: ''startcedeusvms.sh'')
 +
* geonode1204 : 12GB : 6 cpus : 13080 (VRDE 7767) with 200GB (185GB) disk => disk name: geonode1204b.vdi. How to enlarge the disk check [[Nominatim for Traffic Accident Database]] ... however, the Nominatim VM is using 14.04 and not 12.04. NB: this VM has the old pw
 +
* opensuse132 2GB : 2 cpus : 18022 (with https webgui 18052+18547, not yet unblocked console 18161, VRDE 7772)
 +
* wikicedeus : 2GB : 2 cpus : cedeus wiki on ''22080/wiki/'' (VRDE 7769)
 +
* mediawiki : 2GB : 2 cpus : personal wiki on ''21080/mediawiki-1.22.7/'' (VRDE 7771)
 +
* elgg : 4 GB : 4 cpus : 15080 (VRDE 7765) on basicubuntu1404 with LAMPS
 +
* additional there are for testing:
 +
** basicubuntu1404
 +
** geonode1404 : 8GB : 6 cpus : 12080 (VRDE 7768) - this VM is not in use (without GeoNode install)
 +
** wyp : 8GB : 4 cpus : 17080 (with Tomcat and Postgres: 17088 vs 17032, VRDE 3389) http://146.155.17.19:17080/wypwps/
 +
** elgg18pyp : 2GB, 2cpus : 31080 (VRDE 31065) - VM should be shut down
 +
** windows864 3GB : 3 cpus (VRDE 7773) 40 GB
 +
** windowsml1 3GB : 3 cpus (VRDE 7774) 40 GB
 +
 
 +
'''on CedeusDB:'''
 +
(no startup script yet)
 +
* tilestream :  8GB : 4 cpus : with Tilestream on ''16088/#!/map/Fondef'' (VRDE 3389) : http://146.155.17.18:16088/#!/map/Fondef
 +
*: => switched off
 +
* nominatim: 4GB : 4 cpus 200GB : with Nominatim on 146.155.17.18:22080 (VRDE 7761)
 +
*: => Note, Nominatim has port CONFLICT with Gatherer; TODO: fix this
 +
*: => Running only when needed
 +
* otp09: 4GB : 4cpus  : on 146.155.17.18:30088 (VRDE 7762) : http://146.155.17.18:30088/opentripplanner-webapp/#/ : (OpenTripPlanner 0.9)
 +
* cartodb: 8 GB : 6 cpus : on 146.155.17.18:19080 (VRDE 7763) => for testing, but never got it really to work
 +
*: => switched off
 +
* omeka: 6 GB : 4 cpus : on 146.155.17.18:20080 (VRDE 7764) : http://146.155.17.18:20080/omeka/
 +
* owncloud: 6GB : 4 cpus : on 146.155.17.18:17080 (VRDE 7765) : http://146.155.17.18:17080/owncloud/ => http://owncloud.cedeus.cl
 +
* gitlab: 4GB : 2 cpus : on 146.155.17.18:18080 (VRDE 7766) : http://146.155.17.18:18080/  (Off, trasladada a http://146.155.17.14:18080/ )
 +
* indicator 1GB : 1 cpus : on 146.155.17.18:21080 (VRDE 7767) : http://146.155.17.18:21080/
 +
* gatherer 2GB : 1 cpus : on 146.155.17.18:22080 (VRDE 7768) :
 +
* otp 4GB : 4 cpus : on 146.155.17.18:23080 (VRDE 7769) : http://146.155.17.18:23080/ (OpenTripPlanner 0.20) (off, trasladada a http://146.155.17.19:17050/ )
 +
* overpass : 4 GB : 2 cpus : on 146.155.17.18:24080 (VRDE 7770) : http://146.155.17.18:24080/api/interpreter/data=[data] (off, trasladada a http://146.155.17.19:17051/ )
 +
* fondedoc : 2 GB : 1 cpus : on 146.155.17.18:25080 (VRDE 7772) : http://146.155.17.18:25080 para proyector, http://146.155.17.18:25080/tablet para tablet
 +
* geonode20b : 12 GB : 6 cpus : on 146.155.17.18:16080 (VRDE 3389) : http://146.155.17.18:16080 => Copy of GeoNode from June 2015 we used for bug fixing
 +
*: => Note, geonode20b has port CONFLICT with tilestream VM
 +
*: => switched off
 +
* geonodeTest: 8 GB : 4 cpus : on 146.155.17.18:16080 (VRDE 7771) : http://146.155.17.18:16080 => Test of Geonode 2.4
 +
*: => Note, port CONFLICT with tilestream and geonode20b
 +
 
 +
'''CedeusGeoNode reverse-proxy + geosteiniger.cl DNS zone editor settings'''
 +
* GeoNode: 146.155.17.19:13080 => geonode1204 VM => cedeusdata.geosteiniger.cl
 +
* Personal wiki : 1146.155.17.19:21080/mediawiki-1.22.7/ => wiki.geosteiniger.cl/wiki/
 +
* Cedeus wiki : 146.155.17.19/wiki/ => Wiki VM => cedeuswiki.geosteiniger.cl/wiki/
 +
* OTP : 146.155.17.54:8080/opentripplanner-webapp/ => otp.geosteiniger.cl/opentripplanner-webapp/
 +
* Tilestream 146.155.17.18:16088/#!/map/Fondef => tilestream.geosteiniger.cl/#!/map/Fondef
 +
 
 +
Hosting info for [http://www.tcpiputils.com/browse/domain/puc.cl Puc.cl] -> name servers etc.
  
 
== presentaciones ==
 
== presentaciones ==
 
* 18.Dic.2014 : Coloquio "IDE Universidades" de SNIT (M. Bienes) - [http://www.geo.uzh.ch/~sstein/presentations/cedeus/idecedeus.html#0 progreso parte tecnico]
 
* 18.Dic.2014 : Coloquio "IDE Universidades" de SNIT (M. Bienes) - [http://www.geo.uzh.ch/~sstein/presentations/cedeus/idecedeus.html#0 progreso parte tecnico]
 
* xxx
 
* xxx
 +
== cache ==
 +
[[blackboard]]

Latest revision as of 10:35, 25 January 2019

Centro de Desarrollo Urbano Sustentable - CEDEUS

Technical Configuration

Libros del Observatorio

Funciones de Infraestructuras Científicos de Datos Espaciales

Bernard L, Mäs S, Müller M, Henzen C, y J Brauner (2013, J. o. Digital Earth):

  • encontrar y acceder al datos (=> importante: accuracy and scale, lineage and usage)
  • integrar, procesar y analisar informaciones encontrados (=> oferecer servicios de procesamiento geo-espacial y permitir su integracion)
  • publicar y compartir datos, métodos y resultados científicos

Tareas para crear la IDE de Cedeus

my CEDEUS ShortTime ToDo List

CEDEUS Long term ToDo list:

  1. IDEs de Chile existente
  2. Cedeus Technical Architecture
    • TODO: security aspects of the IDE (user types, access management options)
  3. DOCUMENTO: Borrador de Proyecto - development plan for future (clients v.2 v.3) - 15. Dec.
  4. ENCUESTA : user and data survey
    • primero encuesta - hecho en Diciembre 2013 por Nicolas, me mande archivos con la presentación y resultado
    • documents to prepare: (i) envisioned types of IDE use, (ii) list of data (themes) that may be in the institute (checklist?), (iii) data that should not be public, (iv) client types => a mindmap exists already!!
  5. DATOS:
    • Cedeus Base Data
    • Cedeus Convenios
    • Notes:
      • EPSG Santiago (from OCUC dataset): 32719 (= UTM Zone 19 South), EPSG OSM: 4326
      • what exists
      • access rights (see GeoNode access options: public, logged-in user, group, user only)
      • stoarge/db structure (defined by storage structure of GeoNode for shapefiles, rasters are stored in web-folder)
  6. Cedeus Metadata
  7. TYPO DE CLIENTES
    • desktop clients - SIG : TODO inicio de encuesta en los grupos que usan: ArcGIS, QGIS, gvSIG, OpenJUMP, SAGA ...
    • web client- browsers : TODO: a desarrollar
      1. IDE Client Basica : visualisacion de datos solamente
      2. IDE Client Avanzado : con diseno, para ciudadanos
      3. IDE Client Experto : visualisacion, aggregar, manipular

información útil y documentación

List of VMs

PUC Server Ports

on CedeusGeoNode: (see also script: startcedeusvms.sh)

  • geonode1204 : 12GB : 6 cpus : 13080 (VRDE 7767) with 200GB (185GB) disk => disk name: geonode1204b.vdi. How to enlarge the disk check Nominatim for Traffic Accident Database ... however, the Nominatim VM is using 14.04 and not 12.04. NB: this VM has the old pw
  • opensuse132 2GB : 2 cpus : 18022 (with https webgui 18052+18547, not yet unblocked console 18161, VRDE 7772)
  • wikicedeus : 2GB : 2 cpus : cedeus wiki on 22080/wiki/ (VRDE 7769)
  • mediawiki : 2GB : 2 cpus : personal wiki on 21080/mediawiki-1.22.7/ (VRDE 7771)
  • elgg : 4 GB : 4 cpus : 15080 (VRDE 7765) on basicubuntu1404 with LAMPS
  • additional there are for testing:
    • basicubuntu1404
    • geonode1404 : 8GB : 6 cpus : 12080 (VRDE 7768) - this VM is not in use (without GeoNode install)
    • wyp : 8GB : 4 cpus : 17080 (with Tomcat and Postgres: 17088 vs 17032, VRDE 3389) http://146.155.17.19:17080/wypwps/
    • elgg18pyp : 2GB, 2cpus : 31080 (VRDE 31065) - VM should be shut down
    • windows864 3GB : 3 cpus (VRDE 7773) 40 GB
    • windowsml1 3GB : 3 cpus (VRDE 7774) 40 GB

on CedeusDB: (no startup script yet)

CedeusGeoNode reverse-proxy + geosteiniger.cl DNS zone editor settings

  • GeoNode: 146.155.17.19:13080 => geonode1204 VM => cedeusdata.geosteiniger.cl
  • Personal wiki : 1146.155.17.19:21080/mediawiki-1.22.7/ => wiki.geosteiniger.cl/wiki/
  • Cedeus wiki : 146.155.17.19/wiki/ => Wiki VM => cedeuswiki.geosteiniger.cl/wiki/
  • OTP : 146.155.17.54:8080/opentripplanner-webapp/ => otp.geosteiniger.cl/opentripplanner-webapp/
  • Tilestream 146.155.17.18:16088/#!/map/Fondef => tilestream.geosteiniger.cl/#!/map/Fondef

Hosting info for Puc.cl -> name servers etc.

presentaciones

cache

blackboard