SLIDE 1
Building Microservices @ Squarespace
QCon New York 2017
Franklin Angulo @feangulo
Building Microservices @ Squarespace QCon New York 2017 INSERT - - PowerPoint PPT Presentation
Building Microservices @ Squarespace QCon New York 2017 INSERT - - PowerPoint PPT Presentation
Franklin Angulo @feangulo Building Microservices @ Squarespace QCon New York 2017 INSERT IMAGE HERE AGENDA 01 Microservice Framework 02 Organizational Changes 03 New Opportunities & Challenges Service Contextual Healthchecks Discovery
SLIDE 2
SLIDE 3
SLIDE 4
SLIDE 5
SLIDE 6
INSERT IMAGE HERE
SLIDE 7
AGENDA
01 Microservice Framework 02 Organizational Changes 03 New Opportunities & Challenges
SLIDE 8
SERVICE CORE
Microservice Framework
Healthchecks Service Discovery Contextual Information Structured Logging Metrics API Documentation Distributed Tracing Dynamic Configuration
SLIDE 9
Healthchecks
service: name: taxation version: 1.0 server: port: 8080 management: port: 8081
SLIDE 10
Healthchecks
http://taxation101.eqx.dal.prod.squarespace.net:8081/healthcheck { "status":"UP", "taxation-core":{ "healthy":true "message":"Service is running version TAX-459" } }
SLIDE 11
Service Discovery & Registration
Service B Service A Service C Service Discovery Consul Zookeeper
SLIDE 12
Service Discovery & Registration
SLIDE 13
Contextual Information
Client v3.1 Taxation Service Billing Service Context Id Client Version Client Source Type JaOLrH2O
SLIDE 14
Structured Logging
Taxation Service GC Logs Access Logs Application Logs
SLIDE 15
Structured Logging
tail -f /data/logs/taxation-access.log 2017-03-22 07:24:45:026 GMT thread=jetty-846 contextId=JaOLrH2O contextSourceType=billing clientVersion=taxation-client-3.1 level=INFO class=AccessLog ip=10.100.101.205 method=GET uri=/api/1/taxation/rates queryString= httpVersion=HTTP/1.1 responseCode=200 responseTimeMs=39 responseSize=-1 logging.level: DEBUG logging: level:
- rg.springframework: INFO
com.squarespace.metrics.Graphite: "OFF" directory: /data/logs extension: .log maxFileSize: 512MB totalSizeCap: 8GB maxHistory: 5
SLIDE 16
Metrics
graphite: enabled: true enableConsole: false host: {{ graphite_host }} port: {{ graphite_port }}
SLIDE 17
Metrics
http://taxation101.eqx.dal.prod.squarespace.net:8081/metrics { "mem":2210292, "mem.free":831939, "processors":2, "threads":89, "GET.api.1.taxation.tax-overrides.sourceTypes.admin.requests.snapshot.stdDev":0, "GET.api.1.taxation.exemptions.externalId.requests.snapshot.99thPercentile":90, "GET.api.1.taxation.exemptions.requests.oneMinuteRate":2.964393875E-314, "GET.api.1.taxation.exemptions.externalId.requests.meanRate":1.4890452464986816, "PUT.api.1.taxation.tax-overrides.id.decisions.requests.snapshot.98thPercentile":22, "GET.api.1.taxation.vat-countries.list-results.sourceTypes.billing.requests.snapshot.p75":0 }
SLIDE 18
Metrics
SLIDE 19
Distributed Tracing
SLIDE 20
Dynamic Configuration
vars: tracing_sample_rate: prod: 0.2 stage: 1.0 qa1: 1.0
SLIDE 21
Dynamic Configuration
SLIDE 22
API Documentation
SLIDE 23
SERVICE CLIENT
Microservice Framework
Client-Side Load Balancing Latency & Fault Tolerance Client-Side Caching Asynchronous Request Execution HTTP Request Builders
SLIDE 24
Client-Side Load Balancing
Client Service X Service X Service X Service Discovery Application Container
SLIDE 25
Latency & Fault Tolerance
Service B Service A Service C Service A Client Service B Client Service C Client User Request Application Container
SLIDE 26
Latency & Fault Tolerance
Service B Service A Service C Service A Client 10 Threads Service B Client 5 Threads Service C Client 5 Threads User Request
Fail fast, fail silent, or fallback
Application Container
SLIDE 27
Hystrix
SLIDE 28
Client-Side Caching
Service X Service X Client User Request Application Container
SLIDE 29
Asynchronous Request Execution
Client Service A Service Z Application Container Service B Service C Service D
SLIDE 30
HTTP Request Builders
getCurrentProductOfferingTemplate = group .newTemplateBuilder(“getCurrentProductOffering”) .withMethod(HttpMethod.GET.name()) .withUriTemplate(RESOURCE_URL + “/offerings/countries/{country}/current”) .build();
SLIDE 31
ORGANIZATIONAL CHANGES
SLIDE 32
Squarespace Engineering @ 2013
Server Systems Product & Data
SLIDE 33
SLIDE 34
Squarespace Engineering @ 2014
Server TechOps SRE Core Svcs
SLIDE 35
Location Taxation Billing Currency
The First Services
SLIDE 36
Provisioning
Provisioning
- Cobbler
- IP Plan
- DNS
- LDAP
- YUM
- NTP
SLIDE 37
Ansible & Configuration Management
SLIDE 38
Release Engineering / Developer Productivity
Release Engineering & Developer Productivity Drone Helm
SLIDE 39
Ansible & Configuration Management hello-service/deploy/deploy.yml:
SLIDE 40
Ansible & Configuration Management hello-service/deploy/config.yml.j2:
SLIDE 41
Build & Deploy Tooling
SLIDE 42
Observability & Alerting
Observability & Alerting
SLIDE 43
Observability & Alerting Tooling
SLIDE 44
Observability & Alerting Tooling
SLIDE 45
Observability & Alerting Tooling
SLIDE 46
Observability & Alerting Tooling
SLIDE 47
Observability & Alerting Tooling
SLIDE 48
Service Dashboard
SLIDE 49
NEW OPPORTUNITIES AND CHALLENGES
SLIDE 50
SLIDE 51
SLIDE 52
SLIDE 53
SLIDE 54
SLIDE 55
SLIDE 56
SLIDE 57
SLIDE 58
FUTURE WORK
Self-service provisioning Code generation Pull-based metrics Log collection improvements Distributed tracing improvements Alerting improvements
SLIDE 59
Microservices Journey
2013: small (< 50 engineers) build product & grow customer base whatever works 2014: medium (< 100 engineers) we have a lot of customers now! whatever works doesn't work anymore 2016: large (100+ engineers) architect for scalability and reliability
- rganizational structures
?: XL (200+ engineers)
SLIDE 60
QUESTIONS
Thank you!
squarespace.com/careers Franklin Angulo @feangulo