Amazon Redshift Serverless – Now Usually Accessible with New Capabilities

0
1

4a54

4a54
4a54

4a54
4a54

4a54
4a54 4a54

4a54
4a54 4a54

4a54
4a54 4a54

4a54
4a54

4a54
4a54

4a54
4a54 4a54
4a54 4a54 4a54
4a54 4a54
4a54 4a54

4a54
4a54 4a54 4a54
4a54 4a54

4a54

4a54
4a54

4a54 Final 12 months at 4a54 re:Invent 4a54 , we 4a54 launched the preview 4a54 of 4a54 Amazon Redshift Serverless 4a54 , a serverless choice of 4a54 4a54 Amazon Redshift 4a54 that permits you to 4a54 analyze knowledge at any scale 4a54 with out having to handle 4a54 knowledge warehouse infrastructure. You simply 4a54 must load and question your 4a54 knowledge, and also you pay 4a54 just for what you employ. 4a54 This permits extra corporations to 4a54 construct a contemporary knowledge technique, 4a54 particularly to be used instances 4a54 the place analytics workloads should 4a54 not operating 24-7 and the 4a54 info warehouse isn’t energetic on 4a54 a regular basis. It is 4a54 usually relevant to corporations the 4a54 place the usage of knowledge 4a54 expands throughout the group and 4a54 customers in new departments wish 4a54 to run analytics with out 4a54 having to take possession of 4a54 information warehouse infrastructure.

4a54
4a54

4a54 At present, I’m glad to 4a54 share that Amazon Redshift Serverless 4a54 is 4a54 typically accessible 4a54 and that we added 4a54 many new capabilities. We’re additionally 4a54 lowering Amazon Redshift Serverless compute 4a54 prices in comparison with the 4a54 preview.

4a54
4a54

4a54 Now you can create a 4a54 number of serverless endpoints per 4a54 AWS account and 4a54 Area 4a54 utilizing namespaces and workgroups:

4a54
4a54

    4a54
    4a54

  • 4a54 A 4a54 namespace 4a54 is a set of 4a54 database objects and customers, akin 4a54 to database title and password, 4a54 permissions, and encryption configuration. That 4a54 is the place your knowledge 4a54 is managed and the place 4a54 you may see how a 4a54 lot storage is used.
  • 4a54
    4a54

  • 4a54 A 4a54 workgroup 4a54 is a set of 4a54 compute sources, together with community 4a54 and safety settings. Every workgroup 4a54 has a serverless endpoint to 4a54 which you’ll join your purposes. 4a54 When configuring a workgroup, you 4a54 may arrange personal or publicly 4a54 accessible endpoints.
  • 4a54
    4a54

4a54
4a54

4a54 Every namespace can have just 4a54 one workgroup related to it. 4a54 Conversely, every workgroup could be 4a54 related to just one namespace. 4a54 You may have a namespace 4a54 with none workgroup related to 4a54 it, for instance, to make 4a54 use of it just for 4a54 sharing knowledge with different namespaces 4a54 in the identical or one 4a54 other AWS account or Area.

4a54
4a54

4a54 In your workgroup configuration, now 4a54 you can use question monitoring 4a54 guidelines to assist maintain your 4a54 prices below management. Additionally, the 4a54 best way Amazon Redshift Serverless 4a54 routinely scales knowledge warehouse capability 4a54 is extra clever to ship 4a54 quick efficiency for demanding and 4a54 unpredictable workloads.

4a54
4a54

4a54 Let’s see how this works 4a54 with a fast demo. Then, 4a54 I’ll present you what you 4a54 are able to do with 4a54 namespaces and workgroups.

4a54
4a54

4a54 Utilizing Amazon Redshift Serverless
4a54 Within the 4a54 Amazon Redshift console 4a54 , I choose 4a54 Redshift serverless 4a54 within the navigation pane. 4a54 To get began, I select 4a54 4a54 Use default settings 4a54 to configure a namespace 4a54 and a workgroup with the 4a54 commonest choices. For instance, I’ll 4a54 have the ability to join 4a54 utilizing my 4a54 default VPC 4a54 and 4a54 default safety group 4a54 .

4a54
4a54

Console screenshot.

4a54
4a54

4a54 With the default settings, the 4a54 one choice left to configure 4a54 is 4a54 Permissions 4a54 . Right here, I can 4a54 specify how Amazon Redshift can 4a54 work together with different providers 4a54 akin to S3, 4a54 Amazon CloudWatch 4a54 Logs, 4a54 Amazon SageMaker 4a54 , and 4a54 AWS Glue 4a54 . To load knowledge later, 4a54 I give Amazon Redshift entry 4a54 to an S3 bucket. I 4a54 select 4a54 Handle IAM roles 4a54 after which 4a54 Create IAM position 4a54 .

4a54
4a54

Console screenshot.

4a54
4a54

4a54 When creating the IAM position, 4a54 I choose the choice to 4a54 provide entry to 4a54 particular S3 buckets 4a54 and choose an S3 4a54 bucket in the identical AWS 4a54 Area. Then, I select 4a54 Create IAM position as default 4a54 to finish the creation 4a54 of the position and to 4a54 routinely use it because the 4a54 default position for the namespace.

4a54
4a54

Console screenshot.

4a54
4a54

4a54 I select 4a54 Save configuration 4a54 and after a couple 4a54 of minutes the database is 4a54 prepared to be used. Within 4a54 the 4a54 Serverless dashboard 4a54 , I select 4a54 Question knowledge 4a54 to open the 4a54 Redshift question editor v2 4a54 . There, I comply with 4a54 the 4a54 directions within the Amazon Redshift 4a54 Database Developer information to load 4a54 a pattern database 4a54 . If you wish to 4a54 do a fast check, a 4a54 couple of pattern databases (together 4a54 with the one I’m utilizing 4a54 right here) are already accessible 4a54 within the 4a54 sample_data_dev 4a54 database. Notice additionally that 4a54 loading knowledge into Amazon Redshift 4a54 isn’t required for operating queries. 4a54 I can use knowledge from 4a54 an S3 knowledge lake in 4a54 my queries by 4a54 creating an exterior schema and 4a54 an exterior desk 4a54 .

4a54
4a54

4a54 The pattern database consists of 4a54 seven tables and tracks gross 4a54 sales exercise for a fictional 4a54 “TICKIT” web site, the place 4a54 customers purchase and promote tickets 4a54 for sporting occasions, reveals, and 4a54 concert events.

4a54
4a54

Sample database tables relations

4a54
4a54

4a54 To configure the database schema, 4a54 I run a couple of 4a54 SQL instructions to create the 4a54 4a54 customers 4a54 , 4a54 venue 4a54 , 4a54 class 4a54 , 4a54 date 4a54 , 4a54 occasion 4a54 , 4a54 itemizing 4a54 , and 4a54 gross sales 4a54 tables.

4a54
4a54

Console screenshot.

4a54
4a54

4a54 Then, I obtain the 4a54 tickitdb.zip 4a54 file that comprises the 4a54 pattern knowledge for the database 4a54 tables. I unzip and cargo 4a54 the information to a 4a54 tickit 4a54 folder in the identical 4a54 S3 bucket I used when 4a54 configuring the IAM position.

4a54
4a54

4a54 Now, I can use the 4a54 4a54 COPY command 4a54 to load the info 4a54 from the S3 bucket into 4a54 my database. For instance, to 4a54 load knowledge into the 4a54 customers 4a54 desk:

4a54
4a54

 4a54 copy customers from 's3://MYBUCKET/tickit/allusers_pipe.txt' iam_role  4a54 default;

4a54
4a54

4a54 The file containing the info 4a54 for the 4a54 gross sales 4a54 desk makes use of 4a54 tab-separated values:

4a54
4a54

 4a54 copy gross sales from 's3://MYBUCKET/tickit/sales_tab.txt'  4a54 iam_role default delimiter 't' timeformat  4a54 'MM/DD/YYYY HH:MI:SS';

4a54
4a54

4a54 After I load knowledge in 4a54 all tables, I begin operating 4a54 some queries. For instance, the 4a54 next question joins 5 tables 4a54 to seek out the highest 4a54 5 sellers for occasions primarily 4a54 based in California (be aware 4a54 that the pattern knowledge is 4a54 for the 12 months 2008):

4a54
4a54

 4a54 choose sellerid, username, (firstname ||'  4a54 '|| lastname) as sellername, venuestate,  4a54 sum(qtysold)
from gross sales, date, customers,  4a54 occasion, venue
the place gross sales.sellerid  4a54 = customers.userid
and gross sales.dateid =  4a54 date.dateid
and gross sales.eventid = occasion.eventid
and  4a54 occasion.venueid = venue.venueid
and 12 months  4a54 = 2008
and venuestate="CA"
group by sellerid,  4a54 username, sellername, venuestate
order by 5  4a54 desc
restrict 5;

4a54
4a54

Console screenshot.

4a54
4a54

4a54 Now that my database is 4a54 prepared, let’s see what I 4a54 can do by configuring Amazon 4a54 Redshift Serverless namespaces and workgroups.

4a54
4a54

4a54 Utilizing and Configuring Namespaces
4a54 Namespaces are collections of database 4a54 knowledge and their safety configurations. 4a54 Within the navigation pane of 4a54 the Amazon Redshift console, I 4a54 select 4a54 Namespace configuration 4a54 . Within the record, I 4a54 select the 4a54 default 4a54 namespace that I simply 4a54 created.

4a54
4a54

4a54 Within the 4a54 Information backup 4a54 tab, I can create 4a54 or restore a snapshot or 4a54 restore knowledge from one of 4a54 many restoration factors which are 4a54 routinely created each half-hour and 4a54 stored for twenty-four hours. That 4a54 may be helpful to get 4a54 better knowledge in case of 4a54 unintended writes or deletes.

4a54
4a54

Console screenshot.

4a54
4a54

4a54 Within the 4a54 Safety and encryption 4a54 tab, I can replace 4a54 permissions and encryption settings, together 4a54 with the 4a54 AWS Key Administration Service (AWS 4a54 KMS) 4a54 key used to encrypt 4a54 and decrypt my sources. On 4a54 this tab, I may also 4a54 allow audit logging and export 4a54 the person, connection, and person 4a54 exercise logs to CloudWatch Logs.

4a54
4a54

Console screenshot.

4a54
4a54

4a54 Within the 4a54 Datashares 4a54 tab, I can create 4a54 a datashare to share knowledge 4a54 with different namespaces and AWS 4a54 accounts in the identical or 4a54 totally different Areas. On this 4a54 tab, I may also create 4a54 a database from a share 4a54 I obtain from different namespaces 4a54 or AWS accounts, and I 4a54 can see the subscriptions for 4a54 datashares managed by 4a54 AWS Information Change 4a54 .

4a54
4a54

Console screenshot.

4a54
4a54

4a54 Once I create a datashare, 4a54 I can choose which objects 4a54 to incorporate. For instance, right 4a54 here I wish to share 4a54 solely the 4a54 date 4a54 and 4a54 occasion 4a54 tables as a result 4a54 of they don’t comprise delicate 4a54 knowledge.

4a54
4a54

Console screenshot.

4a54
4a54

4a54 Utilizing and Configuring Workgroups
4a54 Workgroups are collections of compute 4a54 sources and their community and 4a54 safety settings. They supply the 4a54 serverless endpoint for the namespace 4a54 they’re configured for. Within the 4a54 navigation pane of the Amazon 4a54 Redshift console, I select 4a54 Workgroup configuration 4a54 . Within the record, I 4a54 select the 4a54 default 4a54 namespace that I simply 4a54 created.

4a54
4a54

4a54 Within the 4a54 Information entry 4a54 tab, I can replace 4a54 the community and safety settings 4a54 (for instance, change the VPC, 4a54 the subnets, or the safety 4a54 group) or make the endpoint 4a54 publicly accessible. On this tab, 4a54 I may also allow 4a54 Enhanced VPC routing 4a54 to route community site 4a54 visitors between my serverless database 4a54 and the info repositories I 4a54 exploit (for instance, the S3 4a54 buckets used to load or 4a54 unload knowledge) by a VPC 4a54 as an alternative of the 4a54 web. To entry serverless endpoints 4a54 which are in one other 4a54 VPC or subnet, I can 4a54 create a 4a54 VPC endpoint 4a54 managed by Amazon Redshift.

4a54
4a54

Console screenshot.

4a54
4a54

4a54 Within the 4a54 Limits 4a54 tab, I can configure 4a54 the bottom capability (expressed in 4a54 Redshift processing models, or RPUs) 4a54 used to course of my 4a54 queries. Amazon Redshift Serverless scales 4a54 the capability to take care 4a54 of the next variety of 4a54 customers. Right here I even 4a54 have the choice to extend 4a54 the bottom capability to hurry 4a54 up my queries or lower 4a54 it to cut back prices.

4a54
4a54

4a54 On this tab, I may 4a54 also set 4a54 Utilization limits 4a54 to configure day by 4a54 day, weekly, and month-to-month thresholds 4a54 to maintain my prices predictable. 4a54 For instance, I configured a 4a54 day by day restrict of 4a54 200 RPU-hours, and a month-to-month 4a54 restrict of two,000 RPU-hours for 4a54 my compute sources. To manage 4a54 the data-transfer prices for cross-Area 4a54 datashares, I configured a day 4a54 by day restrict of three 4a54 TB and a weekly restrict 4a54 of 10 TB. Lastly, to 4a54 restrict the sources utilized by 4a54 every question, I exploit 4a54 Question limits 4a54 to trip queries operating 4a54 for greater than 60 seconds.

4a54
4a54

Console screenshot.

4a54
4a54

4a54 Availability and Pricing
4a54 Amazon Redshift Serverless 4a54 is mostly accessible at 4a54 this time within the US 4a54 East (Ohio), US East (N. 4a54 Virginia), US West (Oregon), Europe 4a54 (Frankfurt), Europe (Eire), Europe (London), 4a54 Europe (Stockholm), and Asia Pacific 4a54 (Seoul), Asia Pacific (Singapore), Asia 4a54 Pacific (Sydney), and Asia Pacific 4a54 (Tokyo) 4a54 AWS Areas 4a54 .

4a54
4a54

4a54 You may hook up with 4a54 a workgroup endpoint utilizing 4a54 your favourite shopper instruments 4a54 through JDBC/ODBC or with 4a54 the 4a54 Amazon Redshift question editor v2 4a54 , a web-based SQL shopper 4a54 utility accessible on the Amazon 4a54 Redshift console. When utilizing internet 4a54 services-based purposes (akin to 4a54 AWS Lambda 4a54 features or 4a54 Amazon SageMaker 4a54 notebooks), you may entry 4a54 your database and carry out 4a54 queries utilizing the built-in 4a54 Amazon Redshift Information API 4a54 .

4a54
4a54

4a54 With Amazon Redshift Serverless, you 4a54 pay just for the compute 4a54 capability your database consumes when 4a54 energetic. The compute capability scales 4a54 up or down routinely primarily 4a54 based in your workload and 4a54 shuts down during times of 4a54 inactivity to avoid wasting time 4a54 and prices. Your knowledge is 4a54 saved in managed storage, and 4a54 also you pay a GB-month 4a54 price.

4a54
4a54

4a54 To present you improved worth 4a54 efficiency and the flexibleness to 4a54 make use of Amazon Redshift 4a54 Serverless for a fair broader 4a54 set of use instances, we’re 4a54 decreasing the value from $0.5 4a54 to $0.375 per RPU-hour for 4a54 the US East (N. Virginia) 4a54 Area. Equally, we’re decreasing the 4a54 value in different Areas by 4a54 a median of 25 p.c 4a54 from the preview worth. For 4a54 extra data, see the  4a54 Amazon Redshift pricing 4a54 web page.

4a54
4a54

4a54 That can assist you get 4a54 observe with your personal use 4a54 instances, we’re additionally offering $300 4a54 in AWS credit for 90 4a54 days to attempt Amazon Redshift 4a54 Serverless. These credit are used 4a54 to cowl your prices for 4a54 compute, storage, and snapshot utilization 4a54 of Amazon Redshift Serverless solely.

4a54
4a54

4a54 Get insights out of your 4a54 knowledge in seconds with Amazon 4a54 Redshift Serverless.

4a54
4a54

4a54 4a54 Danilo

4a54
4a54 4a54
4a54

4a54

LEAVE A REPLY

Please enter your comment!
Please enter your name here