/ Recent content in Home on HanOostdijk Datascience Hugo -- gohugo.io en-us Tue, 10 Aug 2021 00:00:00 +0000 /xiong-an/lingang-and-nanhui-news-all/ Tue, 10 Aug 2021 00:00:00 +0000 /xiong-an/lingang-and-nanhui-news-all/ 05 August 2021 Fitch Affirms Shanghai Lingang’s Rating at ‘A-’; Outlook Stable 28 July 2021 World’s largest astronomy museum opens in China 22 July 2021 Coastal Lingang readies temporary shelters as typhoon In-fa approaches 22 June 2021 Foreign reporters learn of city’s achievements 21 June 2021 AMEC expanding to meet huge demand for chips 18 June 2021 Officials, envoys hail role of Shanghai in opening-up 12 June 2021 Shanghai’s Lingang area to further tap its financial potential 10 June 2021 Foreign exchange pilot program for Lingang Sporting action on the outskirts of the city 09 June 2021 Pudong New Area reports lift shares Shanghai vows to take global lead in transportation sector with its new five-year plan 24 May 2021 Tesla Has Reportedly Localized 90% of Giga Shanghai’s Supplies 18 May 2021 Sweet melons speel summer: low-calorie fruit in abundant supply 15 May 2021 Tesla, TSLA & the Investment World: the Perpetual Investors’ Roundtable 11 May 2021 City to build 150 kindergartens this year 29 April 2021 Lingang launches dedicated Internet access 27 April 2021 Reclaimed Rubber and Rubber Powder Market Analysis by Product Type, Usage, End User … 24 April 2021 Reclaimed Rubber and Rubber Powder Market Growth, Projections, Analysis, Trends and Forecast … 23 April 2021 Ling Ang 19 April 2021 Beverage Bottles Market Will Grow at a Healthy With Top Key Players – Triumbari, FLASKA, TSL … 16 April 2021 Reclaimed Rubber and Rubber Powder Market SWOT Analysis, Industry Size, Growth … 15 April 2021 Shanghai looks to five suburbs to reduce population density in China’s commercial hub 14 April 2021 Nanhui officials outline new town’s future Shanghai looks to five suburbs to reduce population density in China’s commercial hub 11 April 2021 City’s 40th Bird Preservation Week takes flight 10 April 2021 The Future of Digital Currency May Be Chinese 06 April 2021 International technology fair the biggest yet 29 March 2021 Shanghai starts construction of WLF conference site to collaborate with the world’s scientific … 28 March 2021 Shanghai starts construction of WLF conference site to collaborate with the world’s scientific … Spring visit to Pudong’s villages is a peach of an idea Agreement signed to boost development of new towns 16 March 2021 Shanghai launches blueprint to make Lingang a model for high-quality social service by 2035 Lingang to spearhead social services reform 09 March 2021 Lingang levies less taxing for companies 04 March 2021 Shanghai Lingang amis to build a chip hub targeting the Asia-Pacific region in next five years 02 March 2021 City planetarium set for trial operation Tesla mulls further expanding Shanghai Gigafactory /xiong-an/xiong-an-news/ Tue, 10 Aug 2021 00:00:00 +0000 /xiong-an/xiong-an-news/ 10 August 2021 Xiongan makes its first cross-border carbon trade 01 August 2021 GLOBALink | Village on isle turns into green pioneer in China’s Xiongan New Area Beijing’s universities, hospitals and state-owned enterprises will start relocation to Xiong’an in 2021 … 31 July 2021 Progress seen in transfer of noncapital roles 25 June 2021 The sixth stop of the GYLD China Tours: Hebei 17 June 2021 Xiong’an set to welcome new SOEs from Beijing 16 June 2021 China Begins in Xiong’an Payment for Blockchain Digital Yuan PBOC: Chinese consumers will be able to store their digital currency in both physical and digital … China Tech Digest: China’s First “Blockchain+Digital RMB” Application Scenario; Medical Data … 15 June 2021 China Tests Digital Yuan In Wage Payments Chinese Workers Can Now Be Paid In Digital Yuan China’s Xiong’an New Area Begins Using Digital Yuan for Salary Payments 14 June 2021 China debuts blockchain-based digital yuan salary payments in Xiong’an By Cointelegraph 07 June 2021 New bridges for green finance 31 May 2021 Five expressways in Xiongan open to traffic(1 29 May 2021 Three expressways in Xiong’an open to traffic 28 May 2021 Crackdown on ‘unhealthy’ wedding practices in developing city in China to curb vulgar rituals and … 27 May 2021 China is setting up special economical wedding zones 26 May 2021 Cracking Down on ‘Unhealthy’ Wedding Customs: Xiong’an New Area Launches Wedding Reform … 23 May 2021 Blockchain, the Core of the CCP’s Digital Currency in Its Ambition for Global Hegemony 19 May 2021 GLOBALink | Steps to plant a tree in China’s Xiong’an New Area China: Slow Xiong’an Growth Highlights Risks to Megacity Initiatives 18 May 2021 ‘Invisible hand’ pulls up the handbrake on Xi’s pet project 15 May 2021 Beijing, Xiongan boost road, rail links 12 May 2021 Across China: The green ambition of Xiong’an New Area builders 10 May 2021 Alipay joins China’s digital currency wallet, accelerate digital RMB adoption Hebei reports solid progress as it tackles ‘big three’ tasks 09 May 2021 Tapestry Collection by Hilton enters mainland China China’s new bid to take on Elon Musk’s Starlink: a state-owned satellite enterprise 03 May 2021 Hilton opens first Tapestry Collection property in mainland China 30 April 2021 China Opens State-Owned Satellite Internet Company Hollick Hotel Wen’an, Tapestry Collection by Hilton 29 April 2021 Chinese vice premier stresses quality construction of Xiong’an New Area Chinese vice premier stresses quality construction of Xiong’an New Area 27 April 2021 Intelligent Drawing Future Science Park in Xiongan(1 19 April 2021 China’s top planner emphasizes balanced and efficient modern railway network 16 April 2021 Chinese vice premier stresses Xiong’an New Area’s quality construction 15 April 2021 Latest digital yuan trial is 10x the first. /post/2020/10/10/gross-and-net-excess-eigen-risico-in-dutch-health-care-costs/ Sat, 10 Oct 2020 00:00:00 +0000 /post/2020/10/10/gross-and-net-excess-eigen-risico-in-dutch-health-care-costs/ Date last run: 10Oct2020 Load packages that will be used HOQCutil::silent_library(c('knitr','tidyr','ggplot2')) Introduction The Dutch healthcare system repays insured individuals the costs they have made for health reasons. Of course there are lots of details but the article Understanding ‘Eigen Risico’ gives an introduction. Only costs above a certain amount (the excess that is called ‘eigen risico’ in Dutch) are repaid. The standard excess is 385 euros but an individual can choose a regime with an higher amount and is then compensated by a reduction of the premium according to Table 1: /post/2020/09/28/retrieve-wfs-spatial-data/ Mon, 28 Sep 2020 00:00:00 +0000 /post/2020/09/28/retrieve-wfs-spatial-data/ Date last run: 29Sep2020 Introduction This document shows how to use a query to select only a few features of a WFS data set. With a query on non-spatial attributes I had no problems but when I tried to do something with the spatial attribute (the geometry) I ran into troubles. Trying to solve these I learned that the queries depend on the version of WFS (first I used the latest (2. /links/often-needed-rstudio-community-snippets/ Tue, 28 Jul 2020 00:00:00 +0000 /links/often-needed-rstudio-community-snippets/ Date last run: 01Nov2022 Reprex We don’t really have enough info to help you out. Could I ask you to provide a minimal REPRoducible EXample (reprex)? A reprex makes it much easier for others to understand your issue and figure out how to help. A reprex consists of the minimal code and data needed to recreate the issue/question you’re having. You can find instructions how to build and share one here: /post/2020/07/01/open-street-map-in-r/ Wed, 01 Jul 2020 00:00:00 +0000 /post/2020/07/01/open-street-map-in-r/ Date last run: 01Jul2020 Introduction Here we show how to use Open Street Map vector data to create a map Load the necessary libraries HOQCutil::silent_library(c('sf','osmdata', 'ggplot2', 'dplyr','purrr','stringr')) Read in Open Street Map vector data in given bbox We read all vector data in a (not so) arbitrary environment in the list od. The elements with names starting with ‘osm_’ contain features of the indicated type. We will list the number of features in each of them but will only consider now the ‘polygons’. /post/2020/06/30/using-broom-to-gather-model-results/ Tue, 30 Jun 2020 00:00:00 +0000 /post/2020/06/30/using-broom-to-gather-model-results/ Date last run: 06Jul2020 Introduction Today I was experimenting with some models with a factor variable. I wanted to collect the results of the various models (combinations of the factor variable with other variables). For this I remembered the package broom. This entry documents the code that I used on the iris data set. Load the packages that are needed HOQCutil::silent_library(c('stringr','broom','tibble','purrr','knitr')) Function to construct vector with formulas In the function construct_formulas we create a character vector with all the formulas with intercept where the dependent variable is the first column of a given data. /post/2020/06/17/dplyr-with-rowwise/ Wed, 17 Jun 2020 00:00:00 +0000 /post/2020/06/17/dplyr-with-rowwise/ Date last run: 17Jun2020 Introduction A question was asked in the RStudio Community: Finding closest date relative to another date in a column and subtracting. When I saw that I thought it was a good opportunity to use the rowwise() function of the dplyr package. This is a stylized form of that problem. Load packages and create example data options(knitr.table.format='html') HOQCutil::silent_library(c('dplyr','tidyr')) df1 <- tibble::tribble( ~id, ~x, ~a, ~b, ~c , 1L, 3. /post/2020/06/09/an-html-document-with-aside-s/ Tue, 09 Jun 2020 00:00:00 +0000 /post/2020/06/09/an-html-document-with-aside-s/ Date last run: 09Jun2020 In a question of the RStudio Community Writing a side note on R markdown html #2 the question was raised how to create site notes. A reference was made to an earlier article Writing a side note on R markdown html. Because I was interested I wanted to see what could be done using simple html and css. I had hoped to get a solution with two columns were the side note is placed along the material it is related to, but I could not make that happen. /post/2020/05/14/new-beta-release-for-cbs-odata4-dataportal/ Thu, 14 May 2020 00:00:00 +0000 /post/2020/05/14/new-beta-release-for-cbs-odata4-dataportal/ Date last run: 14May2020 Introduction In the LinkedIn group Centraal Bureau voor de Statistiek; Open Data I saw the article New beta release for CBS OData4 dataportal . The article points to page CBS Dataportal on their website for more information and mentions the new root pointer. In the past I included two functions in package HOQCutil: get_table_cbs_odata4 and get_table_cbs_odata4_GET for version OData4. In this blog entry I check if the two functions in the HOQCutil still work. /post/2020/05/04/using-sweave/ Mon, 04 May 2020 00:00:00 +0000 /post/2020/05/04/using-sweave/ Date last run: 06May2020 I started my first experiments with R and Literate programming with Sweave. After encountering the package knitr on CRAN I never looked back. Triggered by some questions in the RStudio Community I decided to see if it is still workable. After some trial and error I did succeed and decided to write down my experiences. Creating a Sweave file In RStudio one of the File | New File options is R Sweave that creates an almost empty Rnw file. /post/2020/04/29/maelle-salmon-article-about-rmd-and-hugo/ Wed, 29 Apr 2020 00:00:00 +0000 /post/2020/04/29/maelle-salmon-article-about-rmd-and-hugo/ Date last run: 29Apr2020 Introduction When I saw the article Miscellaneous Wisdom about R Markdown & Hugo Gained from Work on our Website by Maëlle Salmon I was interested to try out the part where she shows how to use a knitr hook to change the output of a plot chunk. In this blog entry I note down my findings. I could not get it to work because the generated html for the figure specified the wrong directory (folder). /post/2020/04/24/vraag-in-rcommunity/ Fri, 24 Apr 2020 00:00:00 +0000 /post/2020/04/24/vraag-in-rcommunity/ Date last run: 24Apr2020 Question In the RStudio Community website the question was asked how to produce from an Rmd source only the part of the tex file (without preamble) that inserts a plot. The asker wanted to include that part in another tex file with its own preamble. My solution to generate a pdf and tex file and manually copy the relevant part of the tex file would obviously not work in an automated workflow. /post/2020/04/18/use-of-python-in-r/ Sat, 18 Apr 2020 00:00:00 +0000 /post/2020/04/18/use-of-python-in-r/ Date last run: 26Apr2020 Setup chunk I understood that the setup chunk does not need the library statement for reticulate because it checks if that package is installed. This is not the case, so don’t forget it library(reticulate) knitr::opts_chunk$set(echo = TRUE) Create a testfile write_testfile <- function(outfile) { fo = file(outfile, open = 'wt') on.exit(close(fo), add = T) txt = c ( 'dest,carrier,dep_delay,arr_delay' , 'ORD,KLM,3,4' , 'ORD,KLM,2,5' , 'ORD,BEA,2,5' , 'PSE,KLM,3,4' , 'PSE,KLM,3,4' ) cat(txt, sep = "\n", file = fo, append = F) } write_testfile("flights. /post/2020/03/19/tidyr-lessons-by-jane-wall/ Thu, 19 Mar 2020 00:00:00 +0000 /post/2020/03/19/tidyr-lessons-by-jane-wall/ Date last run: 23Mar2020 I saw that Jane Wall created some tidyr lessons on YouTube. In this blog entry I try to ‘remember’ the things she teaches us and what I have picked up during these lessons. Load the packages that will be used HOQCutil::silent_library(c('dplyr','tidyr','tibble')) Load two example tables and make them ‘longer’ The prefix tidyr:: is not necessary if the package tidyr is loaded (as it is here) but I think it more readable to indicate what the source of the data is: otherwise table4a comes just out of thin air. /post/2020/03/16/scraping-links-from-a-webpage/ Mon, 16 Mar 2020 00:00:00 +0000 /post/2020/03/16/scraping-links-from-a-webpage/ Date last run: 19Mar2020 In a previous blog entry I showed how to scrape a page that uses javascript to fill a table. Doing that I realized that this also explained why I saw a difference in two ways to display the html of a page: display the page in the (Firefox) browser and use File | Save As load the page with xml2::read_html and save it with xml2::write_html In the first case the browser executes the javascript code and in the second the javascript code was not executed until I decided to use the R package RSelenium. /post/2020/03/14/using-rselenium-to-scrape-a-webpage/ Sat, 14 Mar 2020 00:00:00 +0000 /post/2020/03/14/using-rselenium-to-scrape-a-webpage/ Date last run: 14Mar2020 In an RStudio Community message the question was raised how to retrieve a table from a webpage that was generated by javascript . The problem was that the page did not contain the table itself but only a reference to the javascript code. Because I was busy with a similar project, I decided to see if I could solve it. The suggestion to solve the problem was described in a stack overflow entry but it did not work out for the questioner and myself. /post/2020/02/15/silent-library-function/ Sat, 15 Feb 2020 00:00:00 +0000 /post/2020/02/15/silent-library-function/ Date last run: 15Feb2020 Example of messages shown by library While writing a blog entry featuring silent_library I realized that I did not quit make clear what the reason was to create that function. In this entry I show the various ways that messages produced when loading a package can be handled. In an rmarkdown entry as this one we have at least three (four) ways to handle messages when loading a package. /post/2020/02/14/metaprogramming-in-r/ Fri, 14 Feb 2020 00:00:00 +0000 /post/2020/02/14/metaprogramming-in-r/ Date last run: 11Mar2020 (correction typo) Introduction Often having problems with non-standard evaluation I decided to read Hadley Wickham Advanced R chapters about metaprogramming. Problem An example of a problem I met was the case that I wanted to silently load the packages glue and purrr with the function HOQCutil::silent_library. This function accepted both a name and a character string (i.e as well knitr as 'knitr' ) but apparently not a list element containing the name of a package. /post/2020/01/25/use-internal-functions-of-a-package/ Sat, 25 Jan 2020 00:00:00 +0000 /post/2020/01/25/use-internal-functions-of-a-package/ Date last run: 07Feb2020 Update 2020-02-07 This is revised version of the original entry dated 25JAN2020. Introduction In a previous blog entry I mentioned that I would like to have some changes in the tabr package. The author Matt Leonawicz rejected the PR and therefore I wanted to see if they could be included in my package tabraux that contains some extensions on tabr that I think worthwhile. Problem I had made changes in three functions: is_note, phrase and _phrase. /post/2020/01/24/creating-both-html-and-pdf-documents-with-bookdown/ Fri, 24 Jan 2020 00:00:00 +0000 /post/2020/01/24/creating-both-html-and-pdf-documents-with-bookdown/ I added to the GitHub repository Examples of use of rmarkdown for creating pdf-files an example of the use of bookdown to create with one Rmd file both html and pdf documents. The inputs can be found in the input_bookdown folder and the results in the output_bookdown folder. In the description in the .Rmd file I wrote down my objectives: produce a text that would display well in both html and pdf format. /post/2020/01/05/more-tabr-and-lilypond-2/ Sun, 05 Jan 2020 00:00:00 +0000 /post/2020/01/05/more-tabr-and-lilypond-2/ Date last run: 13Jan2020 Introduction In an earlier blog entry I suggested to allow an ‘insert/anchor/hook point’ in the notes in tabr that would make it easier to indicate where changes have to be made. In his GitHub answer Matt Leonawicz liked the general idea, but he was a little worried about the impact it could have on the non-LilyPond related functions and about the time that it would take to implement this. /post/2020/01/03/more-tabr-and-lilypond/ Fri, 03 Jan 2020 00:00:00 +0000 /post/2020/01/03/more-tabr-and-lilypond/ Date last run: 05Jan2020 Introduction To make life a little easier when using the tabr and Lilypond software I built the package tabraux with a few additional functions. When I asked a question to Matt Leonawicz about the insertion of an end bar he very nicely came up with a solution. In the follow up he had the following suggestions for (working with) the package: specifying an vector that gives the indices for which specific measures you want to insert a bar at (type of bar can also be a vector if different bars are required). /links/musical-links/ Fri, 27 Dec 2019 00:00:00 +0000 /links/musical-links/ Date last run: 27Dec2019 Lute music suitable for guitar Google search: ‘playing lute music on guitar’ Intro To The Lute for Guitar Players - Lute Society of America Introduction in PDF format Lute music arranged for guitar from Classical Guitar forum From the Classical Guitar forum. Contains pointers to sheet music for lute. Guitar Loot (ancient manuscripts plundered) Guitar Loot is a collection of my (Eric Crouch) arrangements for Classical Guitar of Renaissance and Baroque Music originally written for Guitar, Lute or related instruments. /links/cartographics-links/ Sat, 21 Dec 2019 00:00:00 +0000 /links/cartographics-links/ Date last run: 02Nov2020 Links related to the Allard Pierson (Special Collection of the University of Amsterdam) Nieuwe aanwinst door het Allard Pierson: de atlas van Saksen door Petrus Schenk jr. uit 1760 By Peter van der Krogt Blogs about cartography by staff members of Allard Pierson De Fransche Neptunus, of Nieuwe atlas van zeekaarten Newly included in the image library of the Allard Pierson Links related to Zeeland English sandbank map from 1826 /links/general-links/ Sat, 21 Dec 2019 00:00:00 +0000 /links/general-links/ Date last run: 04Feb2021 Introduction Collection of links. Work still in progress …. Maps and Carthography Maps Netherlands (in Dutch) http://topotijdreis.nl Maps for the Netherlands from 1815 onwards (Topografische Dienst/Kadaster) https://cartografie-nederland.startpagina.nl/ ‘start pagina’ page for Dutch maps luchtfoto 2018 Latest arial photograph of the Netherlands PDOK viewer Viewer for (some) PDOK maps Publieke Dienstverlening Op de Kaart Platform for digital geographical information from the Dutch local and central government. /note/2019/12/17/producing-an-r-package/ Tue, 17 Dec 2019 00:00:00 +0000 /note/2019/12/17/producing-an-r-package/ Things to remember: Use Document , Clean and Rebuild, Test Package in the Build tab. To include vignettes use devtools::install(build_vignettes=TRUE). When testing in the package project use Load All in the Build tab. Create a new package (example) This section documents how I created the package tabraux. I can not get the GitHub connection working unless I start with a GitHub repository. Therefore: First create interactively a new GitHub repository Do this by choosing new in the GitHub desktop and filling in the following screen: /post/2019/12/16/creating-scales-with-tabr-and-lilypond/ Mon, 16 Dec 2019 00:00:00 +0000 /post/2019/12/16/creating-scales-with-tabr-and-lilypond/ Date last run: 05Jan2020 To make it easier to ‘code’ musical scores with tabr and Lilypond I have printed the treble and bass scales with the codes of the notes. Remember that guitar music is written one octave higher than it sounds! library(tabr) notes1 <- "e2 f2 g2 a2 b2 c3 d3 e3 f3 g3 a3 b3 c4 d4 e4 f4 g4 a4 b4 c5 d5 e5 f5 g5" times1 <- "4*24" lyrics1 <- strsplit(notes1," ")[[1]] voice1 <- p(notes1,times1,string=NULL) voice1 <- p(notes1,times1,string=NULL) track1 <- track(voice1, voice = 1,tab=F,lyrics=as_lyrics(lyrics1)) notes2 <- "a1 b1 c2 d2 e2 f2 g2 a2 b2 c3 d3 e3 f3 g3 a3 b3 c4 d4 e4 f4 g4 a4 b4 c5" times2 <- "4*24" lyrics2 <- strsplit(notes2," ")[[1]] voice2 <- p(notes2,times2,string=NULL) track2 <- track_bc(voice2, voice = 2,lyrics=as_lyrics(lyrics2)) track3 <- track(voice2, voice = 3,tab=F,lyrics=as_lyrics(lyrics2)) track4 <- track_tc(voice1, voice = 4,lyrics=as_lyrics(lyrics1)) song <- trackbind(track1,track2) %>% score() header <- list(title="Scales", tagline="") paper <- list(first_page_number =4,page_numbers=T,print_first_page_number=F, textheight = 35,linewidth = 120) filename = "opus1" filetype = "png" With the following statement we produce the file opus1. /post/2019/12/07/scanning-documents-with-tesseract-hocr/ Sat, 07 Dec 2019 00:00:00 +0000 /post/2019/12/07/scanning-documents-with-tesseract-hocr/ Date last run: 07Dec2019 Introduction I posted before about using magick and tesseract in postings here and here. Looking again at tesseract because the inputs were changed, I noticed two possibilities to improve the workflow: using the tesseract::ocr_data function that returns a data.frame with the scanned text and a confidence rate and a bounding box for this text the HOCR argument of the tesseract::ocr function that returns an XHTML document with the same elements as tesseract::ocr_data but with an additional line number When I used the tesseract::ocr_data, I needed to derive the line number from the bounding box, so I decided to go for the tesseract::ocr(HOCR=T) option. /post/2019/11/10/retrieving-data-from-statistics-netherlands/ Sun, 10 Nov 2019 00:00:00 +0000 /post/2019/11/10/retrieving-data-from-statistics-netherlands/ Date last run: 08Dec2019 Introduction Recently I tried to reproduce an example in a vignette of my package odataR. See here. To my frustration this did not work any more. After some searching I found out that the layout of the table had changed :( But this gave me reason to study the structure of OData version 3 once again. And off course to adapt the vignette on the new layout. /post/2019/10/31/printing-music-scores/ Thu, 31 Oct 2019 00:00:00 +0000 /post/2019/10/31/printing-music-scores/ Date last run: 01Nov2019 Introduction I bought an old copy of the book “Early dances/Alte Tänze/Danses anciennes” in the series “Piano Step by Step” by publishing house Könemann Music in Budapest. Because I play guitar and not piano I want to transcribe the base part (with the F key/clef) to the the G key that I am accustomed to as amateur guitar player. So I sought a way to print the transcribed key in combination with the original G key. /post/2019/10/24/print-maverick-data/ Thu, 24 Oct 2019 00:00:00 +0000 /post/2019/10/24/print-maverick-data/ Date last run: 25Oct2019 Introduction With the Maverick app it is possible to ‘record’ your walk. This document shows how such a record can be used to represent the walk on a map. Processing Transfer from smart phone to desktop I do not use the ‘pro’ but the free version (version v2.8) and have not found a way to retrieve the recorded gpx file other than via file transfer to my desktop computer. /post/2019/10/17/recipes-for-the-rtweet-package/ Thu, 17 Oct 2019 00:00:00 +0000 /post/2019/10/17/recipes-for-the-rtweet-package/ Date last run: 17Oct2019 Introduction While browsing the internet I found 21 Recipes for Mining Twitter Data with rtweet from Bob Rudis and Paul Campbell. The corresponding github repository points to a blog entry with some background material. In this article I try to replay some of the recipes. In two other articles I described how to find out which urls are generated (url generation in the rtweet package) and what is the program flow in the rtweet functions (Program flow in the rtweet package). /note/2019/10/17/tips-and-tricks/ Thu, 17 Oct 2019 00:00:00 +0000 /note/2019/10/17/tips-and-tricks/ Date last run: 09Apr2021 Searching Task Command Remark Search in files grep -ri ‘text’ recursive and case insensitive Search in files grep -n ‘text’ show line numbers Search in R files grep -ri ‘trace’ --include *.R Helpinfo for grep grep --help NB repeated - ! Find filename(s) find . -name ‘*mag2*‘ find files below current folder containing ‘mag2’ (in Terminal) R Debugging trace(get_trends,quote(browser()),where=asNamespace("rtweet")) rtweet::get_trends("amsterdam") untrace(rtweet::get_trends) as. /post/2019/09/24/twitter-api-and-rtweet/ Tue, 24 Sep 2019 00:00:00 +0000 /post/2019/09/24/twitter-api-and-rtweet/ Date last run: 27Sep2019 Introduction While browsing the internet I found 21 Recipes for Mining Twitter Data with rtweet from Bob Rudis and Paul Campbell. The corresponding github repository points to a blog entry with some background material. While trying to reproduce some of the recipes I was wondering which urls were generated and how the authorisation structure was used to request the data. About the generation of url’s I wrote in url generation in the rtweet package. /post/2019/09/24/url-generation-in-the-rtweet-package/ Tue, 24 Sep 2019 00:00:00 +0000 /post/2019/09/24/url-generation-in-the-rtweet-package/ Date last run: 28Sep2019 Introduction While browsing the internet I found 21 Recipes for Mining Twitter Data with rtweet from Bob Rudis and Paul Campbell. The corresponding github repository points to a blog entry with some background material. While trying to reproduce some of the recipes I was wondering which urls were generated. This document shows how the trace facility can be used to find out. Setup After installing the package rtweet I use the silent_library function to load the package. /post/2019/08/28/scanning-documents-with-tesseract-after-preprocessing-with-magick-a/ Wed, 28 Aug 2019 00:00:00 +0000 /post/2019/08/28/scanning-documents-with-tesseract-after-preprocessing-with-magick-a/ Date last run: 15Sep2019 Since I posted about this subject new versions of the magick and tesseract packages became available. I will try to redo the previous analysis. That is: I want to see if I can use the Tesseract 4 engine with a whitelist. Prepare for scanning (OCR) filename = 'uitslag1.png' img = magick::image_read(filename) magick::image_info(img) #> # A tibble: 1 x 7 #> format width height colorspace matte filesize density #> <chr> <int> <int> <chr> <lgl> <int> <chr> #> 1 PNG 1145 374 sRGB TRUE 27658 38x38 Figure 1: part of image Do the scan (OCR) The magick::image_ocr function uses the tesseract package to do the actual scan. /note/2019/08/26/configuration/ Mon, 26 Aug 2019 00:00:00 +0000 /note/2019/08/26/configuration/ Date last run: 11Aug2021 Software configuration RStudio: 1.5.98 Pandoc: 2.11.4 Hugo: 0.57.2 R and packages #> R version 4.1.0 (2021-05-18) #> Platform: x86_64-w64-mingw32/x64 (64-bit) #> Running under: Windows 10 x64 (build 19042) #> #> Matrix products: default #> #> locale: #> [1] LC_COLLATE=English_United States.1252 #> [2] LC_CTYPE=English_United States.1252 #> [3] LC_MONETARY=English_United States.1252 #> [4] LC_NUMERIC=C #> [5] LC_TIME=English_United States.1252 #> #> attached base packages: #> [1] stats graphics grDevices utils datasets methods base #> #> other attached packages: #> [1] blogdown_0. /post/2019/08/23/first-experiments-with-netlogo/ Fri, 23 Aug 2019 00:00:00 +0000 /post/2019/08/23/first-experiments-with-netlogo/ Being interested (on amateur level) in both archaeology and simulations, it was just a matter of time to run into the multi-agent programmable modeling environment NetLogo that is authored by Uri Wilensky and developed at the Northwestern’s Center for Connected Learning and Computer-Based Modeling CCL. The direct reason was the announcement of the online course Modelling and Simulation in Archaeology by Fulco Scherjon (Leiden University), Iza Romanowska (Barcelona Supercomputing Center) and Karsten Lambers (Leiden University). /post/2019/08/19/hugo-error-in-handling-lists/ Mon, 19 Aug 2019 00:00:00 +0000 /post/2019/08/19/hugo-error-in-handling-lists/ After hugo version 0.57 I noticed that a list immediately followed by a code block forces an empty line between the list and its last entry. This can be solved by inserting an non-empty line or even a comment. This was already marked as an issue in github. My new list: first entry second entry third entry my nice code Another new list with the last entry followed by "<! /note/2019/08/13/custom-rendering/ Tue, 13 Aug 2019 00:00:00 +0000 /note/2019/08/13/custom-rendering/ Date last run: 11Aug2021 When an updated version of the tesseract package became available I realised that a post about working with magick and tesseract was possibly no longer valid. So I thought I should create a new post with a reference to the old one, but then I realised that the old .Rmd file would be rendered anyway with the new package. Browsing the internet I found a post by Hiroaki Yutani that learned me how to custom build the website with the build script. /post/2019/07/31/modified-config-statements-for-firefox/ Wed, 31 Jul 2019 00:00:00 +0000 /post/2019/07/31/modified-config-statements-for-firefox/ introduction I understood from the xs4all helpdesk that the DNS server of my internet provider supports 'DNS over HTTPS' (see e.g. Cloudflare and Wikipedia) . Because I read that the Mozilla Firefox browser supports this, I thought that I would use this (and preferably with the xs4all server). config statements for the Cloudflare server On the internet I found several suggestions to make this work. The most helpful was a very detailed webpage by Daniel Stenberg (bagder) containing also a link to an unofficial list of list of 'DNS over HTTPS' (DoH) servers. /xiong-an/chinese-newspapers/ Mon, 29 Jul 2019 00:00:00 +0000 /xiong-an/chinese-newspapers/ Chinese newspapers in the English language Global Times According to Wikipedia The Global Times (simplified Chinese: 环球时报; traditional Chinese: 環球時報; pinyin: Huánqiú Shíbào) is a daily Chinese tabloid newspaper under the auspices of the People’s Daily newspaper, focusing on international issues from the Chinese government’s perspective. China Daily No ‘direction statement’ found on the website. According to Wikipedia China Daily (Chinese: 中国日报; pinyin: Zhōngguó Rìbào) is an English-language daily newspaper owned by the Publicity Department of the Communist Party of China and published in the People’s Republic of China. /xiong-an/scmp-xiongan-topics/ Thu, 25 Jul 2019 00:00:00 +0000 /xiong-an/scmp-xiongan-topics/ 16 Sep 2019 President Xi’s dream city aims at all-round intelligent infrastructure 03 May 2019 Battle for Beijing airport slots offers rare glimpse into China politics 24 February 2019 ‘Greater Bay Area’ has an edge on the Xiongan New Area … for now 28 January 2019 Is Xi getting impatient with lack of progress on ‘future city’? 30 November 2018 How rival US and Chinese innovators can find common cause /post/2019/07/01/image-and-enlargement-of-a-section/ Mon, 01 Jul 2019 00:00:00 +0000 /post/2019/07/01/image-and-enlargement-of-a-section/ div.mycap { font-size: 0.9em; font-style: italic; color: grey; } -- In this document we show how to create an image consisting of image and a subsection of that image. We use the R package magick. For details about these packages see the reference manual and vignette. In Figure 1 we show the original input. We extract the animal shaped figure and position an enlarged version beside the original version in Figure 2. /post/2019/06/28/scanning-documents-with-tesseract-after-preprocessing-with-magick/ Fri, 28 Jun 2019 00:00:00 +0000 /post/2019/06/28/scanning-documents-with-tesseract-after-preprocessing-with-magick/ Date last run: 27Aug2019 From a website I could download the results of various laboratory tests on blood samples. Apart from the latest result each document also lists the previous ones. The best way I could find to download these documents was to use the Microsoft Screenshot Snipping Tool and save the snip as a png file. In the remainder I describe how I handled these files with the R packages magick and tesseract. /post/2019/06/10/remove-low-storage-message-after-windows-update/ Mon, 10 Jun 2019 00:00:00 +0000 /post/2019/06/10/remove-low-storage-message-after-windows-update/ After the Windows 10 version 1903 update I got with regular intervals a message indicating that there was low storage on local disk W . According to a link on the internet (my case being drive letter W and not F) this was caused by the following That is a System partition that has been mistakenly given a drive letter. That partition was always there, and it needs to be there. /post/2019/05/30/gimp-links-to-introductionary-lessons/ Thu, 30 May 2019 00:00:00 +0000 /post/2019/05/30/gimp-links-to-introductionary-lessons/ GIMP GIMP (GNU Image Manipulation Program) is a Free & Open Source Image Editor. GIMP is a cross-platform image editor available for GNU/Linux, OS X, Windows and more operating systems. It is free software, you can change its source code and distribute your changes. Whether you are a graphic designer, photographer, illustrator, or scientist, GIMP provides you with sophisticated tools to get your job done. You can further enhance your productivity with GIMP thanks to many customization options and 3rd party plugins. /post/2019/05/15/handling-google-alerts/ Wed, 15 May 2019 00:00:00 +0000 /post/2019/05/15/handling-google-alerts/ Introduction Because I am interested in the development of Xiongan New Area nearby Beijing, I am subscribed to Google Alerts on that subject. For this website I keep track of these alerts in two entries: Google Alerts ‘xiongan new area (latest only)’ (the latest download). This entry is no longer included in the website because it is generated with “draft: true” Google Alerts ‘xiongan new area’ (all until now). /post/2019/04/28/creating-bitmap-file-with-magick/ Sun, 28 Apr 2019 00:00:00 +0000 /post/2019/04/28/creating-bitmap-file-with-magick/ This post describes my struggle to create a bitmap file with the Magick package. My assumption is that I should be able to specify each bit of a bitmap file. After some experimenting I can now create a bitmap file with contents more or less (but not exactly) what I want. The following code is used: make_plot <- function (window_width, line_width, start=1, res=72) { m2 = window_width / 2 ; m3 = window_width fig <- magick::image_graph( width = m3, height = m3, res = res) parold = par(mar = c(0, 0, 0, 0)) plot. /note/2019/04/04/producing-a-pull-request-pr/ Thu, 04 Apr 2019 00:00:00 +0000 /note/2019/04/04/producing-a-pull-request-pr/ Steps to do: fork in GitHub the repository (lockedata/namer) that contains the package for which you want to create a pull request. The new repository is called HanOostdijk/namer clone the (forked!) package to your local machine. In RStudio this can be done with File|New Project|Version Control|Git and specify as Repository URL the value found in the Clone or Download box on FitHub create a branch that I will name HOQC1 by typing in the terminal window git checkout -b HOQC1. /post/2019/03/19/checking-future-balances-with-expected-transactions/ Tue, 19 Mar 2019 00:00:00 +0000 /post/2019/03/19/checking-future-balances-with-expected-transactions/ Today I was checking to see if the balance on some accounts would be positive in the future given some transactions that I had planned. My bank does not provide this information (probably because they fear that not all relevant transactions are given as input and therefore the final balances will be incorrect). Therefore I used the following R script that handles an input sheet as displayed here: # packages used (but not loaded) # library(magrittr) # library(readxl) # library(cellranger) # library(dplyr) # library(tidyr) path = 'Rekeningen. /post/2019/02/13/osm-kadaster1/ Wed, 13 Feb 2019 00:00:00 +0000 /post/2019/02/13/osm-kadaster1/ Date last run: 15Sep2019 Introduction This document shows how one can display WFS data ( see here for some links about the Web Feature Service ) against a background of Open Street Map tiles. In this document we use data of the Kadaster. The description in English indicates: The Netherlands’ Cadastre, Land Registry and Mapping Agency – in short Kadaster – collects and registers administrative and spatial data on property and the rights involved. /post/2019/02/01/wfs-links/ Fri, 01 Feb 2019 00:00:00 +0000 /post/2019/02/01/wfs-links/ Introduction article by Egge-Jan Pollé : http://twiav.nl/nl/WFS_R.php PDOK : https://www.pdok.nl/ Web Feature Service : http://www.opengeospatial.org/standards/wfs Open Geospatial Consortium OGC : http://www.opengeospatial.org/ WFS Web Feature Service standard : http://www.opengeospatial.org/standards/wfs CSW Catalogue Services for the Web standard : http://www.opengeospatial.org/standards/cat readthedocs : http://pdok-ngr.readthedocs.io/services.html Publieke Dienstverlening Op de Kaart : https://geodata.nationaalgeoregister.nl/ catalog : http://nationaalgeoregister.nl/geonetwork/srv/dut/csw?request=GetCapabilities&Service=CSW&Version=2.0.1 GeoServer WFS Reference : http://docs.geoserver.org/latest/en/user/services/wfs/reference.html GeoServer Tutorial : http://docs.geoserver.org/stable/en/user/tutorials/cql/cql_tutorial.html GeoServer filtering : http://docs.geoserver.org/stable/en/user/filter/index LINZ : https://www.linz.govt.nz/data/linz-data-service/guides-and-documentation/wfs-spatial-filtering ArcGIS : http://enterprise.arcgis.com/en/server/latest/publish-services/windows/communicating-with-a-wfs-service-in-a-web-browser.htm /post/2019/01/28/handling-scmp-topics/ Mon, 28 Jan 2019 00:00:00 +0000 /post/2019/01/28/handling-scmp-topics/ Introduction Because I am interested in the development of Xiongan New Area nearby Beijing, I regularly check the South China Morning Post topic on that subject. I use the following code to retrieve the relevant articles in the webpage SCMP Xiongan topics : # do_rvest.scmp.R source("./R/rvest_scmp.R") do_it <- function (version = 'v2', suf = 'test') { tmp_table = read_scmp_topics( "https://www.scmp.com/topics/xiongan-new-area", lastpage = -1, version = version ) %>% dplyr::arrange(desc(d)) if (stringr::str_length(suf) == 0) { suf1 = '' suf2 = '' draft1 = 'false' } else { suf1 = glue::glue(' {suf}') suf2 = glue::glue('-{suf}') draft1 = 'true' } topictable_to_web_page( intable = tmp_table, outfile = glue::glue(". /note/2019/01/14/building-this-website/ Mon, 14 Jan 2019 00:00:00 +0000 /note/2019/01/14/building-this-website/ Date last run: 11Aug2021 This website I am starting to build a website with the blogdown package in the Hugo environment with the hugo-xmin theme. Most of the content until now consists of material included for illustration and documentation purposes by Yihui Xie. All credits to Yihui Xie and friends. The old about page by Yihui is still included in this website here. Had problems while deploying to a subfolder of old website Hugo Forums provided as solution to include the following statements in config. /about/ Mon, 01 Jan 0001 00:00:00 +0000 /about/ About the website This website serves as my public memory. Writing an entry for it forces me to do just a little more research and often I find that very beneficial. I am a big fan of The R Project for Statistical Computing and especially of its possibilities for reproducible research with markdown, rmarkdown, knitr, pandoc and hugo. This is a hugo website created with the R package blogdown using the hugo theme Xmin. /org_about/ Mon, 01 Jan 0001 00:00:00 +0000 /org_about/ XMin is the first Hugo theme I have designed. The original reason that I wrote it was I needed a minimal example of Hugo themes when I was writing the blogdown book. Basically I wanted a simple theme that supports a navigation menu, a home page, other single pages, lists of pages, blog posts, categories, tags, and RSS. That is all. Nothing fancy. In terms of CSS and JavaScript, I really want to keep them minimal.